Apr 21 20:46:10 devstack cinder-volume[72326]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:46:10 devstack cinder-volume[72326]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:46:10 devstack cinder-volume[72326]: we strongly recommend against using it for new projects. Apr 21 20:46:10 devstack cinder-volume[72326]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:46:10 devstack cinder-volume[72326]: framework. For more detail see Apr 21 20:46:10 devstack cinder-volume[72326]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:46:10 devstack cinder-volume[72326]: import eventlet # noqa Apr 21 20:46:11 devstack cinder-volume[72326]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:46:11 devstack cinder-volume[72326]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:46:11 devstack cinder-volume[72326]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:46:12 devstack cinder-volume[72326]: INFO dbcounter [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Registered counter for database cinder Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG oslo_db.sqlalchemy.engines [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG dbcounter [-] [72326] Writer thread running {{(pid=72326) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.rpc [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.rpc [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG oslo_db.sqlalchemy.engines [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.volume.manager [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Determined volume DB was empty at startup. Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG cinder.volume.manager [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72326) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.volume.manager [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:46:12 devstack cinder-volume[72326]: WARNING stevedore.named [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:46:12 devstack cinder-volume[72326]: WARNING castellan.key_manager [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:46:12 devstack cinder-volume[72326]: WARNING cinder.keymgr.conf_key_mgr [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG cinder.volume.drivers.lvm [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72326) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG oslo_concurrency.processutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG oslo_concurrency.processutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] CMD "cinder-rtstool verify" returned: 0 in 0.218s {{(pid=72326) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG oslo_db.sqlalchemy.engines [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.rpc [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.rpc [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 21 20:46:12 devstack cinder-volume[72326]: WARNING stevedore.named [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:46:12 devstack cinder-volume[72326]: WARNING castellan.key_manager [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:46:12 devstack cinder-volume[72326]: INFO cinder.volume.manager [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 21 20:46:12 devstack cinder-volume[72326]: DEBUG oslo_db.sqlalchemy.engines [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:13 devstack cinder-volume[72326]: INFO oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Starting 1 workers Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Started child 72432 {{(pid=72326) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Full set of CONF: {{(pid=72326) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] ******************************************************************************** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Configuration options gathered from: {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] ================================================================================ {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] allow_availability_zone_fallback = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] allow_compression_on_image_upload = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] allowed_direct_url_schemes = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72432]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] api_rate_limit = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] auth_strategy = keystone {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] az_cache_duration = 3600 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_availability_zone = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_host = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_stats_polling_interval = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backup_api_class = cinder.backup.api.API {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backup_name_template = backup-%s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backup_use_same_host = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backup_use_temp_snapshot = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] chap_password = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] chap_username = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_internal_tenant_project_id = 63c8b0c50f3a4f5ab874d8b2b5f25004 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_internal_tenant_user_id = 647ee8be8fc64e229dcf14e0094756fc {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cloned_volume_same_az = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cluster = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] compression_format = gzip {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] compute_api_class = cinder.compute.nova.API {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] config_dir = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] config_source = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] control_exchange = openstack {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] debug = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] default_availability_zone = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] default_group_type = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] default_volume_type = lvmdriver-1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] disk_geometry = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] driver_client_cert = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] driver_client_cert_key = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] driver_data_namespace = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] driver_ssl_cert_path = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] driver_ssl_cert_verify = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] driver_use_ssl = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] enable_force_upload = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] enable_new_services = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] enable_unsupported_driver = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] enforce_multipath_for_image_xfer = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] filter_function = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_api_insecure = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_api_ssl_compression = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_ca_certificates_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_catalog_info = image:glance:publicURL {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_num_retries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance_request_timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] goodness_function = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] graceful_shutdown_timeout = 5 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] group_api_class = cinder.group.api.API {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] host = devstack {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_compress_on_upload = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_conversion_address_space_limit = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_conversion_cpu_limit = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_conversion_disable = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_upload_use_cinder_backend = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_upload_use_internal_tenant = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_volume_cache_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_volume_cache_max_count = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] image_volume_cache_max_size_gb = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] init_host_max_objects_retrieval = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] instance_format = [instance: %(uuid)s] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] iscsi_target_flags = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] iscsi_write_cache = on {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] iser_helper = tgtadm {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] iser_ip_address = 192.168.122.16 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] iser_port = 3260 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_color = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_config_append = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_dir = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_options = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_rotate_interval = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_rotate_interval_type = days {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] log_rotation_type = none {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] max_age = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] max_logfile_count = 30 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] max_logfile_size_mb = 200 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] max_over_subscription_ratio = 20.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] message_reap_interval = 86400 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] message_ttl = 2592000 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] migration_create_volume_timeout_secs = 300 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] monkey_patch = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] monkey_patch_modules = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] my_ip = 192.168.122.16 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] no_snapshot_gb_quota = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] num_iser_scan_tries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] num_shell_tries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] num_volume_device_scan_tries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] nvmeof_conn_info_version = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] nvmet_ns_id = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] nvmet_port_id = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_max_limit = 1000 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_volume_ext_list = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_volume_listen_port = 8776 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_volume_use_ssl = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] osapi_volume_workers = 2 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] per_volume_size_limit = -1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] periodic_fuzzy_delay = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] periodic_interval = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] public_endpoint = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] publish_errors = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_backup_gigabytes = 1000 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_backups = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_gigabytes = 1000 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_groups = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_snapshots = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] quota_volumes = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] rate_limit_burst = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] rate_limit_except_level = CRITICAL {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72432]: INFO cinder.volume.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] rate_limit_interval = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] reinit_driver_count = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] replication_device = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] report_discard_supported = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] report_interval = 120 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] reservation_clean_interval = 86400 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] reservation_expire = 86400 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] reserved_image_namespaces = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] reserved_percentage = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] rpc_response_timeout = 120 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] run_external_periodic_tasks = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] scst_target_driver = iscsi {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] scst_target_iqn_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_down_time = 720 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] shell_completion = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] snapshot_name_template = snapshot-%s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] snapshot_same_host = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] split_loggers = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] state_path = /opt/stack/data/cinder {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] storage_availability_zone = nova {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] storage_protocol = iSCSI {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] syslog_log_facility = LOG_USER {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] target_helper = lioadm {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] target_ip_address = 192.168.122.16 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] target_port = 3260 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] target_protocol = iscsi {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] target_secondary_ip_addresses = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] trace_flags = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] transport_url = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] until_refresh = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_chap_auth = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_default_quota_class = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_journal = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_json = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_multipath_for_image_xfer = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_stderr = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] use_syslog = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] verify_glance_signatures = enabled {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_api_class = cinder.volume.api.API {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_backend_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_clear = zero {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_clear_ionice = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_clear_size = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_copy_bps_limit = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_dd_blocksize = 1M {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_name_template = volume-%s {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_service_inithost_offload = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volume_usage_audit_period = month {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] zoning_mode = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_concurrency.disable_process_locking = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.admin_password = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.admin_token = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.admin_user = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_port = 35357 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_protocol = https {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_section = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_type = password {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_uri = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.auth_version = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.cache = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.identity_uri = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.include_service_catalog = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.insecure = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.interface = public {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_password = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcache_username = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.region_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.service_type = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.backend = dogpile.cache.null {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.backend_argument = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.backend_expiration_time = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.config_prefix = cache.oslo {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.debug_cache_backend = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.enable_retry_client = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.enable_socket_keepalive = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.enforce_fips_mode = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.expiration_time = 600 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.hashclient_retry_attempts = 2 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_dead_retry = 300 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_pool_maxsize = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_sasl_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.password = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.proxies = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.redis_db = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.redis_server = localhost:6379 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.retry_attempts = 2 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.retry_delay = 0.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.socket_keepalive_count = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.socket_keepalive_idle = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.socket_keepalive_interval = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.socket_timeout = 1.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.tls_allowed_ciphers = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.tls_cafile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.tls_certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.tls_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.tls_keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cache.username = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] coordination.backend_url = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.asyncio_connection = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.asyncio_slave_connection = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.backend = sqlalchemy {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.connection = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.connection_debug = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.connection_parameters = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.connection_recycle_time = 3600 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.connection_trace = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.db_inc_retry_interval = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.db_max_retries = 20 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.db_max_retry_interval = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.db_retry_interval = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.max_overflow = 50 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.max_pool_size = 5 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.max_retries = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.mysql_wsrep_sync_wait = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.pool_timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.retry_interval = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.slave_connection = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.sqlite_synchronous = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.synchronous_reader = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] database.use_db_reconnect = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.connection_string = messaging:// {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.es_doc_type = notification {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.es_scroll_size = 10000 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.es_scroll_time = 2m {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.filter_error_trace = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.hmac_keys = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.sentinel_service_name = mymaster {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.socket_timeout = 0.1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.trace_requests = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler.trace_sqlalchemy = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler_jaeger.process_tags = {} {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler_jaeger.service_name_prefix = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] profiler_otlp.service_name_prefix = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.enforce_new_defaults = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: WARNING oslo_config.cfg [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.enforce_scope = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.policy_default_rule = default {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.policy_file = policy.yaml {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.group = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.helper_command = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] privsep_osbrick.user = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.group = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.helper_command = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] cinder_sys_admin.user = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.auth_section = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.auth_type = password {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.cafile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.collect_timing = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.insecure = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.send_service_user_token = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.split_loggers = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] service_user.timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.auth_section = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.auth_type = password {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.collect_timing = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.insecure = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.region_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.split_loggers = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] glance.timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.backend_availability_zone = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.chap_password = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.chap_username = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.disk_geometry = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.driver_client_cert = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.driver_client_cert_key = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.driver_data_namespace = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.driver_use_ssl = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.extra_capabilities = {} {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.filter_function = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.goodness_function = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.iscsi_target_flags = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.iscsi_write_cache = on {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.iser_helper = tgtadm {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.iser_port = 3260 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.lvm_share_target = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.lvm_type = auto {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.num_shell_tries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.replication_device = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.report_discard_supported = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.reserved_percentage = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.target_helper = tgtadm {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.target_port = 3260 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.target_protocol = iscsi {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.trace_flags = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.unique_fqdn_network = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.use_chap_auth = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_backend_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_clear = zero {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_clear_ionice = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_clear_size = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_reports.file_event_handler = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_reports.log_dir = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.backend_host = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.chap_password = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.chap_username = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.disk_geometry = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.driver_client_cert = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack sudo[72436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack sudo[72436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.extra_capabilities = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.filter_function = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.goodness_function = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.iser_helper = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.iser_ip_address = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.iser_port = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.lvm_share_target = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.lvm_type = auto {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.num_shell_tries = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.replication_device = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.report_discard_supported = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.reserved_percentage = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.scst_target_driver = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.storage_protocol = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.target_helper = lioadm {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.target_ip_address = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.target_port = 3260 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.trace_flags = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.use_chap_auth = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_clear = zero {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_clear_size = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] lvmdriver-1.volumes_dir = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.ssl = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_notifications.driver = [] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_notifications.retry = -1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] key_manager.fixed_key = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.barbican_api_version = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.barbican_endpoint = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.barbican_endpoint_type = public {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.barbican_region_name = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.cafile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.collect_timing = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.insecure = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.number_of_retries = 60 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.retry_delay = 1 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.send_service_user_token = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.split_loggers = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.verify_ssl = True {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican.verify_ssl_path = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.auth_section = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.auth_type = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.cafile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.certfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.collect_timing = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.insecure = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.keyfile = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.split_loggers = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] barbican_service_user.timeout = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.approle_role_id = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.approle_secret_id = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.kv_mountpoint = secret {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.kv_path = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.kv_version = 2 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.namespace = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.root_token_id = **** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.ssl_ca_crt_file = None {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.timeout = 60.0 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.use_ssl = False {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:46:13 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] ******************************************************************************** {{(pid=72326) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:46:13 devstack sudo[72436]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.515s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:13 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:13 devstack sudo[72583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:13 devstack sudo[72583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:14 devstack sudo[72583]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.507s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:46:14 devstack cinder-volume[72432]: INFO cinder.brick.local_dev.lvm [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:14 devstack sudo[72795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:14 devstack sudo[72795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:14 devstack sudo[72795]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG cinder.brick.local_dev.lvm [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72432) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 21 20:46:14 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:14 devstack sudo[72956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:14 devstack sudo[72956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:15 devstack sudo[72956]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:15 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.769s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:15 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:15 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:15 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:15 devstack sudo[73106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:15 devstack sudo[73106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:16 devstack sudo[73106]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:16 devstack sudo[73127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 21 20:46:16 devstack sudo[73127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:16 devstack sudo[73127]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.452s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:16 devstack sudo[73130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:16 devstack sudo[73130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:16 devstack sudo[73130]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:16 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:16 devstack sudo[73138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:16 devstack sudo[73138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:17 devstack sudo[73138]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:17 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:17 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:17 devstack sudo[73141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:17 devstack sudo[73141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:17 devstack sudo[73141]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:17 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:17 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:17 devstack sudo[73146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:17 devstack sudo[73146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:18 devstack sudo[73146]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:18 devstack sudo[73150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:18 devstack sudo[73150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:18 devstack sudo[73150]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:18 devstack cinder-volume[72432]: INFO cinder.volume.drivers.lvm [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:18 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:18 devstack sudo[73157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:18 devstack sudo[73157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:19 devstack sudo[73157]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:19 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:19 devstack cinder-volume[72432]: DEBUG cinder.volume.drivers.lvm [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Updating volume stats {{(pid=72432) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:46:19 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:19 devstack sudo[73232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:19 devstack sudo[73232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:19 devstack sudo[73232]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:19 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:19 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:19 devstack sudo[73278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:19 devstack sudo[73278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:20 devstack sudo[73278]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:20 devstack sudo[73403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:20 devstack sudo[73403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:20 devstack sudo[73403]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:20 devstack sudo[73420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:20 devstack sudo[73420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:20 devstack sudo[73420]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:20 devstack cinder-volume[72432]: INFO cinder.volume.driver [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG cinder.volume.driver [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72432) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG oslo_db.sqlalchemy.engines [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG dbcounter [-] [72432] Writer thread running {{(pid=72432) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:46:20 devstack cinder-volume[72432]: DEBUG cinder.db.sqlalchemy.api [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Building query based on filter {{(pid=72432) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG cinder.image.image_utils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72432) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:46:21 devstack cinder-volume[72432]: INFO cinder.keymgr.migration [None req-b7bd5673-0f0e-4e9c-93bc-d439f6ea9654 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG cinder.volume.drivers.lvm [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Updating volume stats {{(pid=72432) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:21 devstack sudo[73427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:21 devstack sudo[73427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:21 devstack sudo[73427]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:21 devstack sudo[73432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:21 devstack sudo[73432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:21 devstack sudo[73432]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:21 devstack sudo[73435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:21 devstack sudo[73435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:22 devstack sudo[73435]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:22 devstack sudo[73438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:22 devstack sudo[73438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:22 devstack sudo[73438]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG cinder.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Notifying Schedulers of capabilities ... {{(pid=72432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:46:22 devstack cinder-volume[72432]: INFO cinder.volume.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Driver initialization completed successfully. Apr 21 20:46:22 devstack cinder-volume[72432]: INFO cinder.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Initiating service 2 cleanup Apr 21 20:46:22 devstack cinder-volume[72432]: INFO cinder.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Service 2 cleanup completed. Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG cinder.service [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Creating RPC server for service cinder-volume {{(pid=72432) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG cinder.service [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72432) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:46:22 devstack cinder-volume[72432]: INFO cinder.volume.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG cinder.volume.drivers.lvm [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Updating volume stats {{(pid=72432) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:46:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:22 devstack sudo[73447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:46:22 devstack sudo[73447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:23 devstack cinder-volume[72326]: DEBUG dbcounter [-] [72326] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72326) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:46:23 devstack sudo[73447]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:23 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:23 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:23 devstack sudo[73453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:23 devstack sudo[73453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:23 devstack sudo[73453]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:23 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:23 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:23 devstack sudo[73456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:46:23 devstack sudo[73456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:24 devstack sudo[73456]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:24 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:24 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:46:24 devstack sudo[73516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:46:24 devstack sudo[73516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:46:24 devstack sudo[73516]: pam_unix(sudo:session): session closed for user root Apr 21 20:46:24 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:46:24 devstack cinder-volume[72432]: INFO cinder.volume.manager [None req-5d24be88-db2d-4745-ac6a-0feb4cc734b1 None None] Driver post RPC initialization completed successfully. Apr 21 20:46:34 devstack cinder-volume[72432]: DEBUG dbcounter [-] [72432] Writing DB stats cinder:SELECT=3 {{(pid=72432) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:46:34 devstack cinder-volume[72432]: DEBUG dbcounter [-] [72432] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72432) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:47:20 devstack cinder-volume[72432]: DEBUG oslo_service.periodic_task [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72432) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:47:20 devstack cinder-volume[72432]: DEBUG cinder.volume.drivers.lvm [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Updating volume stats {{(pid=72432) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:47:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:20 devstack sudo[78244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:47:20 devstack sudo[78244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:21 devstack sudo[78244]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:21 devstack sudo[78251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:21 devstack sudo[78251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:21 devstack sudo[78251]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:21 devstack sudo[78254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:47:21 devstack sudo[78254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:22 devstack sudo[78254]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.415s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:47:22 devstack sudo[78257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:47:22 devstack sudo[78257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:47:22 devstack sudo[78257]: pam_unix(sudo:session): session closed for user root Apr 21 20:47:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:47:22 devstack cinder-volume[72432]: DEBUG cinder.manager [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Notifying Schedulers of capabilities ... {{(pid=72432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:48:20 devstack cinder-volume[72432]: DEBUG oslo_service.periodic_task [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72432) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:48:20 devstack cinder-volume[72432]: DEBUG cinder.volume.drivers.lvm [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Updating volume stats {{(pid=72432) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:48:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:20 devstack sudo[79313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:48:20 devstack sudo[79313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:21 devstack sudo[79313]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:21 devstack sudo[79356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:21 devstack sudo[79356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:21 devstack sudo[79356]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:21 devstack sudo[79399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:48:21 devstack sudo[79399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:22 devstack sudo[79399]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.421s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:48:22 devstack sudo[79413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:48:22 devstack sudo[79413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:48:22 devstack sudo[79413]: pam_unix(sudo:session): session closed for user root Apr 21 20:48:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:48:22 devstack cinder-volume[72432]: DEBUG cinder.manager [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Notifying Schedulers of capabilities ... {{(pid=72432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:48:34 devstack cinder-volume[72432]: DEBUG dbcounter [-] [72432] Writing DB stats cinder:SELECT=1 {{(pid=72432) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:48:34 devstack cinder-volume[72432]: DEBUG dbcounter [-] [72432] Writing DB stats cinder:UPDATE=1 {{(pid=72432) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:20 devstack cinder-volume[72432]: DEBUG oslo_service.periodic_task [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72432) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:49:20 devstack cinder-volume[72432]: DEBUG cinder.volume.drivers.lvm [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Updating volume stats {{(pid=72432) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 21 20:49:20 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:20 devstack sudo[81018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 21 20:49:20 devstack sudo[81018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:21 devstack sudo[81018]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:21 devstack sudo[81022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:21 devstack sudo[81022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:21 devstack sudo[81022]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.409s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:21 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:21 devstack sudo[81025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 21 20:49:21 devstack sudo[81025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:22 devstack sudo[81025]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.415s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:22 devstack sudo[81044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 21 20:49:22 devstack sudo[81044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:22 devstack sudo[81044]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:22 devstack cinder-volume[72432]: DEBUG oslo_concurrency.processutils [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72432) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:22 devstack cinder-volume[72432]: DEBUG cinder.manager [None req-b7b1527e-c506-4c37-b0e3-c2c28a888869 None None] Notifying Schedulers of capabilities ... {{(pid=72432) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:49:36 devstack cinder-volume[72326]: INFO oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Caught SIGTERM, stopping children Apr 21 20:49:36 devstack cinder-volume[72326]: DEBUG oslo_concurrency.lockutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Acquiring lock "singleton_lock" {{(pid=72326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:49:36 devstack cinder-volume[72326]: DEBUG oslo_concurrency.lockutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Acquired lock "singleton_lock" {{(pid=72326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:49:36 devstack cinder-volume[72326]: DEBUG oslo_concurrency.lockutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Releasing lock "singleton_lock" {{(pid=72326) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:49:36 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Stop services. {{(pid=72326) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:49:36 devstack cinder-volume[72326]: DEBUG oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Killing children. {{(pid=72326) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:49:36 devstack cinder-volume[72326]: INFO oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Waiting on 1 children to exit Apr 21 20:49:37 devstack cinder-volume[72432]: DEBUG oslo_concurrency.lockutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Acquiring lock "singleton_lock" {{(pid=72432) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:49:37 devstack cinder-volume[72432]: DEBUG oslo_concurrency.lockutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Acquired lock "singleton_lock" {{(pid=72432) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:49:37 devstack cinder-volume[72432]: DEBUG oslo_concurrency.lockutils [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Releasing lock "singleton_lock" {{(pid=72432) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:49:37 devstack cinder-volume[72432]: WARNING amqp [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:49:37 devstack cinder-volume[72432]: WARNING amqp [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:49:37 devstack cinder-volume[72326]: INFO oslo_service.backend._eventlet.service [None req-b8c01b82-f168-4c48-aad4-04dabdcc8365 None None] Child 72432 exited with status 0 Apr 21 20:49:38 devstack cinder-volume[81489]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:49:38 devstack cinder-volume[81489]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:49:38 devstack cinder-volume[81489]: we strongly recommend against using it for new projects. Apr 21 20:49:38 devstack cinder-volume[81489]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:49:38 devstack cinder-volume[81489]: framework. For more detail see Apr 21 20:49:38 devstack cinder-volume[81489]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:49:38 devstack cinder-volume[81489]: import eventlet # noqa Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:49:40 devstack cinder-volume[81489]: INFO dbcounter [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Registered counter for database cinder Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG oslo_db.sqlalchemy.engines [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writer thread running {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:49:40 devstack cinder-volume[81489]: INFO cinder.rpc [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:49:40 devstack cinder-volume[81489]: INFO cinder.rpc [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG oslo_db.sqlalchemy.engines [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Determined volume DB was empty at startup. Apr 21 20:49:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81489) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:49:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 21 20:49:40 devstack cinder-volume[81489]: WARNING stevedore.named [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:49:40 devstack cinder-volume[81489]: WARNING castellan.key_manager [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:49:40 devstack cinder-volume[81489]: WARNING cinder.keymgr.conf_key_mgr [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:49:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_db.sqlalchemy.engines [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:41 devstack cinder-volume[81489]: INFO oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Starting 1 workers Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Started child 81608 {{(pid=81489) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Full set of CONF: {{(pid=81489) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] ******************************************************************************** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Configuration options gathered from: {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:49:41 devstack cinder-volume[81608]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] ================================================================================ {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] allow_availability_zone_fallback = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] allow_compression_on_image_upload = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] allowed_direct_url_schemes = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] api_rate_limit = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] auth_strategy = keystone {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_availability_zone = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_host = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_stats_polling_interval = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backup_api_class = cinder.backup.api.API {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backup_name_template = backup-%s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backup_use_same_host = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backup_use_temp_snapshot = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] chap_password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] chap_username = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_internal_tenant_project_id = 63c8b0c50f3a4f5ab874d8b2b5f25004 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_internal_tenant_user_id = 647ee8be8fc64e229dcf14e0094756fc {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cluster = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] compression_format = gzip {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] compute_api_class = cinder.compute.nova.API {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] config_dir = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] config_source = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] control_exchange = openstack {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] debug = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] default_availability_zone = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] default_group_type = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] default_volume_type = QuobyteHD {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] disk_geometry = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] driver_client_cert = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] driver_client_cert_key = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] driver_data_namespace = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] driver_ssl_cert_path = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] driver_ssl_cert_verify = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81608]: INFO cinder.volume.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] driver_use_ssl = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.remotefs [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81608) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] enable_new_services = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] enable_unsupported_driver = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] enabled_backends = ['QuobyteHD'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] enforce_multipath_for_image_xfer = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] filter_function = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_api_insecure = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_api_ssl_compression = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_ca_certificates_file = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_catalog_info = image:glance:publicURL {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_num_retries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance_request_timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] goodness_function = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] graceful_shutdown_timeout = 5 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] group_api_class = cinder.group.api.API {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] host = devstack {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_compress_on_upload = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_conversion_address_space_limit = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_conversion_cpu_limit = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_conversion_disable = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_upload_use_cinder_backend = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_upload_use_internal_tenant = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_volume_cache_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_volume_cache_max_count = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] image_volume_cache_max_size_gb = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] init_host_max_objects_retrieval = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] instance_format = [instance: %(uuid)s] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] iscsi_target_flags = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] iscsi_write_cache = on {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] iser_helper = tgtadm {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] iser_ip_address = 192.168.122.16 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] iser_port = 3260 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_color = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_config_append = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_dir = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_file = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_options = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_rotate_interval = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_rotate_interval_type = days {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] log_rotation_type = none {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] max_age = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] max_logfile_count = 30 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] max_logfile_size_mb = 200 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] max_over_subscription_ratio = 20.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] message_reap_interval = 86400 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] message_ttl = 2592000 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] migration_create_volume_timeout_secs = 300 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] monkey_patch = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] monkey_patch_modules = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] my_ip = 192.168.122.16 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] no_snapshot_gb_quota = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] num_iser_scan_tries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] num_shell_tries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] num_volume_device_scan_tries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] nvmeof_conn_info_version = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] nvmet_ns_id = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] nvmet_port_id = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_max_limit = 1000 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_volume_ext_list = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_volume_listen = 0.0.0.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_volume_listen_port = 8776 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_volume_use_ssl = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] osapi_volume_workers = 2 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] per_volume_size_limit = -1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] periodic_fuzzy_delay = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] periodic_interval = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] project_id_regex = [0-9a-f\-]+ {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] public_endpoint = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] publish_errors = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_backup_gigabytes = 1000 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_backups = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_gigabytes = 1000 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_groups = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_snapshots = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] quota_volumes = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] rate_limit_burst = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] rate_limit_except_level = CRITICAL {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] rate_limit_interval = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] reinit_driver_count = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] replication_device = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] report_discard_supported = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] report_interval = 120 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] reservation_clean_interval = 86400 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] reservation_expire = 86400 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] reserved_image_namespaces = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] reserved_percentage = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81608) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:49:41 devstack cinder-volume[81608]: WARNING cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:49:41 devstack cinder-volume[81608]: WARNING cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] rpc_response_timeout = 120 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Running cmd (subprocess): mount.quobyte {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] run_external_periodic_tasks = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] scst_target_driver = iscsi {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] scst_target_iqn_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_down_time = 720 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] shell_completion = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] snapshot_name_template = snapshot-%s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] split_loggers = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] state_path = /opt/stack/data/cinder {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] storage_availability_zone = nova {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] storage_protocol = iSCSI {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] syslog_log_facility = LOG_USER {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] target_helper = lioadm {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] target_ip_address = 192.168.122.16 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] target_port = 3260 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] target_protocol = iscsi {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] target_secondary_ip_addresses = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] trace_flags = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] transfer_api_class = cinder.transfer.api.API {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] transport_url = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] until_refresh = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_chap_auth = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_default_quota_class = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_journal = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_json = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_multipath_for_image_xfer = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_stderr = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] use_syslog = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] verify_glance_signatures = enabled {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_api_class = cinder.volume.api.API {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_backend_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_clear = zero {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_clear_ionice = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_clear_size = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_copy_bps_limit = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_dd_blocksize = 1M {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_name_template = volume-%s {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_service_inithost_offload = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volume_usage_audit_period = month {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] zoning_mode = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_concurrency.disable_process_locking = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.admin_password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.admin_token = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.admin_user = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_admin_prefix = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_port = 35357 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_protocol = https {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_section = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_type = password {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_uri = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.auth_version = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.cache = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.delay_auth_decision = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.http_connect_timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.identity_uri = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.include_service_catalog = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.insecure = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.interface = public {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_password = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcache_username = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.region_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.service_token_roles_required = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.service_type = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.token_cache_time = 300 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.backend = dogpile.cache.null {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.backend_argument = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.backend_expiration_time = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.config_prefix = cache.oslo {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.debug_cache_backend = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.enable_retry_client = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.enable_socket_keepalive = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.enforce_fips_mode = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.expiration_time = 600 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.hashclient_retry_attempts = 2 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack quobyte-client[81609]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:49:41 devstack quobyte-client[81609]: Invalid parameters found, error: missing mount point. Apr 21 20:49:41 devstack quobyte-client[81609]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:49:41 devstack quobyte-client[81609]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_dead_retry = 300 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_pool_maxsize = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_sasl_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.proxies = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.redis_db = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.redis_sentinel_service_name = mymaster {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.redis_server = localhost:6379 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.retry_attempts = 2 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.retry_delay = 0.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.socket_keepalive_count = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.socket_keepalive_idle = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.socket_keepalive_interval = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.socket_timeout = 1.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.tls_allowed_ciphers = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.tls_cafile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.tls_certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.tls_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.tls_keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cache.username = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] coordination.backend_url = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.asyncio_connection = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.asyncio_slave_connection = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.backend = sqlalchemy {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81608) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.connection = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81608]: INFO cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc ... Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.connection_debug = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b -c /etc/quobyte/client-cinder.cfg {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.connection_parameters = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.connection_recycle_time = 3600 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.connection_trace = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.db_inc_retry_interval = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.db_max_retries = 20 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.db_max_retry_interval = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.db_retry_interval = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.max_overflow = 50 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.max_pool_size = 5 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.max_retries = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.mysql_wsrep_sync_wait = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.pool_timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.retry_interval = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.slave_connection = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.sqlite_synchronous = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.synchronous_reader = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] database.use_db_reconnect = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.connection_string = messaging:// {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.es_doc_type = notification {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.es_scroll_size = 10000 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.es_scroll_time = 2m {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.filter_error_trace = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.hmac_keys = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.sentinel_service_name = mymaster {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack sudo[81610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b -c /etc/quobyte/client-cinder.cfg Apr 21 20:49:41 devstack sudo[81610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.socket_timeout = 0.1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.trace_requests = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler.trace_sqlalchemy = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler_jaeger.process_tags = {} {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler_jaeger.service_name_prefix = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] profiler_otlp.service_name_prefix = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.enforce_new_defaults = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: WARNING oslo_config.cfg [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.enforce_scope = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.policy_default_rule = default {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.policy_file = policy.yaml {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_policy.remote_timeout = 60.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.group = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.helper_command = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] privsep_osbrick.user = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.group = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.helper_command = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] cinder_sys_admin.user = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.auth_section = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.auth_type = password {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.cafile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.collect_timing = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.insecure = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.send_service_user_token = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.split_loggers = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] service_user.timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.auth_section = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.auth_type = password {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.collect_timing = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.insecure = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.region_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.split_loggers = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] glance.timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.backend_availability_zone = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.chap_password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.chap_username = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.disk_geometry = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.driver_client_cert = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.driver_client_cert_key = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.driver_data_namespace = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.driver_use_ssl = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.enable_unsupported_driver = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.extra_capabilities = {} {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.filter_function = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.goodness_function = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.iscsi_target_flags = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.iscsi_write_cache = on {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.iser_helper = tgtadm {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.iser_port = 3260 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_host = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_login = admin {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_mount_options = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_private_key = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_share_path = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_ssh_port = 22 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.num_shell_tries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.nvmet_port_id = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_client_cfg = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.quobyte_volume_url = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.replication_device = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.report_discard_supported = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.reserved_percentage = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.scst_target_driver = iscsi {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.scst_target_iqn_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.storage_protocol = iSCSI {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.target_helper = tgtadm {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.target_port = 3260 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.target_protocol = iscsi {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.trace_flags = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.unique_fqdn_network = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.use_chap_auth = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_backend_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_clear = zero {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_clear_ionice = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_clear_size = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_reports.file_event_handler = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_reports.log_dir = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.backend_availability_zone = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.backend_host = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.chap_password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.chap_username = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.chiscsi_conf = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.disk_geometry = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.driver_client_cert = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.driver_client_cert_key = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.driver_data_namespace = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.driver_use_ssl = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.extra_capabilities = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.filter_function = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.goodness_function = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.iscsi_target_flags = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.iscsi_write_cache = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.iser_helper = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.iser_ip_address = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.iser_port = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.iser_target_prefix = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_host = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_login = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_mount_options = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_password = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_private_key = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_share_path = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_ssh_port = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.num_shell_tries = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nvmet_ns_id = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.nvmet_port_id = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.replication_device = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.report_discard_supported = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.reserved_percentage = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.scst_target_driver = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.storage_protocol = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.target_helper = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.target_ip_address = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.target_port = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.target_prefix = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.target_protocol = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.trace_flags = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.unique_fqdn_network = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.use_chap_auth = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_clear = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_clear_ionice = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_clear_size = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] QuobyteHD.volumes_dir = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.ssl = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.ssl_version = {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_notifications.driver = [] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_notifications.retry = -1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] oslo_messaging_notifications.transport_url = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] key_manager.fixed_key = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.barbican_api_version = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.barbican_endpoint = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.barbican_endpoint_type = public {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.barbican_region_name = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.cafile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.collect_timing = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.insecure = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.number_of_retries = 60 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.retry_delay = 1 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.send_service_user_token = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.split_loggers = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.verify_ssl = True {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican.verify_ssl_path = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.auth_section = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.auth_type = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.cafile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.certfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.collect_timing = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.insecure = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.keyfile = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.split_loggers = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] barbican_service_user.timeout = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.approle_role_id = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.approle_secret_id = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.kv_mountpoint = secret {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.kv_path = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.kv_version = 2 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.namespace = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.root_token_id = **** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.ssl_ca_crt_file = None {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.timeout = 60.0 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.use_ssl = False {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:41 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] ******************************************************************************** {{(pid=81489) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:49:41 devstack sudo[81610]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.502s {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:41 devstack cinder-volume[81608]: INFO cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc succeeded Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81608) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.508s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:41 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:41 devstack sudo[81681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:41 devstack sudo[81681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:42 devstack sudo[81681]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.372s {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:42 devstack cinder-volume[81608]: INFO cinder.volume.driver [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.volume.driver [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81608) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81608) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG dbcounter [-] [81608] Writer thread running {{(pid=81608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.db.sqlalchemy.api [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Building query based on filter {{(pid=81608) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.image.image_utils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81608) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:49:42 devstack cinder-volume[81608]: INFO cinder.keymgr.migration [None req-e3daf2a8-bf62-4807-808f-84ee1570541a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81608) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81608) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:42 devstack sudo[81684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:42 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:42 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.376s {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Notifying Schedulers of capabilities ... {{(pid=81608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:49:42 devstack cinder-volume[81608]: INFO cinder.volume.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Driver initialization completed successfully. Apr 21 20:49:42 devstack cinder-volume[81608]: INFO cinder.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Initiating service 3 cleanup Apr 21 20:49:42 devstack cinder-volume[81608]: INFO cinder.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Service 3 cleanup completed. Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.service [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Creating RPC server for service cinder-volume {{(pid=81608) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.service [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81608) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:49:42 devstack cinder-volume[81608]: INFO cinder.volume.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81608) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81608) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:42 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:42 devstack sudo[81689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:42 devstack sudo[81689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:43 devstack sudo[81689]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:43 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.405s {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:43 devstack cinder-volume[81608]: INFO cinder.volume.manager [None req-bf1c6c5a-c872-4b7a-a476-3e66029f9ee1 None None] Driver post RPC initialization completed successfully. Apr 21 20:49:45 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:45 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:45 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81608) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:45 devstack cinder-volume[81608]: DEBUG cinder.volume.drivers.quobyte [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81608) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:45 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81608) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:45 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:45 devstack sudo[81754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:45 devstack sudo[81754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:46 devstack sudo[81754]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:46 devstack cinder-volume[81608]: DEBUG oslo_concurrency.processutils [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.369s {{(pid=81608) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:46 devstack cinder-volume[81608]: DEBUG cinder.manager [None req-24c28ec9-2ca4-4bfb-922c-0b372ebdb3a3 None None] Notifying Schedulers of capabilities ... {{(pid=81608) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:49:49 devstack cinder-volume[81489]: INFO oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Caught SIGTERM, stopping children Apr 21 20:49:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Acquiring lock "singleton_lock" {{(pid=81489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:49:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Acquired lock "singleton_lock" {{(pid=81489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:49:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Releasing lock "singleton_lock" {{(pid=81489) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:49:49 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Stop services. {{(pid=81489) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 21 20:49:49 devstack cinder-volume[81489]: DEBUG oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Killing children. {{(pid=81489) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 21 20:49:49 devstack cinder-volume[81489]: INFO oslo_service.backend._eventlet.service [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Waiting on 1 children to exit Apr 21 20:49:53 devstack cinder-volume[81608]: DEBUG dbcounter [-] [81608] Writing DB stats cinder:SELECT=3 {{(pid=81608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:53 devstack cinder-volume[81608]: DEBUG dbcounter [-] [81608] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=81608) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:49:55 devstack cinder-volume[81608]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 21 20:49:55 devstack cinder-volume[81855]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 21 20:49:55 devstack cinder-volume[81855]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:49:55 devstack cinder-volume[81855]: we strongly recommend against using it for new projects. Apr 21 20:49:55 devstack cinder-volume[81855]: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:49:55 devstack cinder-volume[81855]: framework. For more detail see Apr 21 20:49:55 devstack cinder-volume[81855]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:49:55 devstack cinder-volume[81855]: import eventlet # noqa Apr 21 20:49:55 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Acquiring lock "singleton_lock" {{(pid=81608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:49:55 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Acquired lock "singleton_lock" {{(pid=81608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:49:55 devstack cinder-volume[81608]: DEBUG oslo_concurrency.lockutils [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Releasing lock "singleton_lock" {{(pid=81608) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:49:55 devstack cinder-volume[81608]: WARNING amqp [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:49:55 devstack cinder-volume[81608]: WARNING amqp [None req-8b30d32f-58de-4d97-b09e-52e1b7a325da None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 21 20:49:56 devstack cinder-volume[81855]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81855) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 21 20:49:56 devstack cinder-volume[81855]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81855) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 21 20:49:56 devstack cinder-volume[81855]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81855) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 21 20:49:57 devstack cinder-volume[81855]: INFO dbcounter [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Registered counter for database cinder Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG dbcounter [-] [81855] Writer thread running {{(pid=81855) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:49:57 devstack cinder-volume[81855]: INFO cinder.rpc [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 21 20:49:57 devstack cinder-volume[81855]: INFO cinder.rpc [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:57 devstack cinder-volume[81855]: INFO cinder.volume.manager [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Determined volume DB was empty at startup. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG cinder.volume.manager [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81855) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 21 20:49:57 devstack cinder-volume[81855]: WARNING stevedore.named [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 21 20:49:57 devstack cinder-volume[81855]: WARNING castellan.key_manager [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:49:57 devstack cinder-volume[81855]: WARNING cinder.keymgr.conf_key_mgr [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 21 20:49:57 devstack cinder-volume[81855]: INFO cinder.volume.manager [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_db.sqlalchemy.engines [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81855) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:57 devstack cinder-volume[81855]: INFO oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Starting 1 workers Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Started child 81991 {{(pid=81855) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Full set of CONF: {{(pid=81855) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] ******************************************************************************** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Configuration options gathered from: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] ================================================================================ {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] allow_availability_zone_fallback = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] allow_compression_on_image_upload = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81991]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] allowed_direct_url_schemes = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] api_rate_limit = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] auth_strategy = keystone {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_host = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_stats_polling_interval = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backup_api_class = cinder.backup.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backup_name_template = backup-%s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backup_use_same_host = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backup_use_temp_snapshot = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] chap_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] chap_username = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_internal_tenant_project_id = 63c8b0c50f3a4f5ab874d8b2b5f25004 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_internal_tenant_user_id = 647ee8be8fc64e229dcf14e0094756fc {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cluster = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] compression_format = gzip {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] compute_api_class = cinder.compute.nova.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] config_dir = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] config_source = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] control_exchange = openstack {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] debug = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] default_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] default_group_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] default_volume_type = QuobyteHD {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] disk_geometry = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] driver_client_cert = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] driver_client_cert_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] driver_data_namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] driver_ssl_cert_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] driver_ssl_cert_verify = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] driver_use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] enable_new_services = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] enable_unsupported_driver = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] enabled_backends = ['QuobyteHD'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] enforce_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] filter_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_api_insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_api_servers = ['http://192.168.122.16/image'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_api_ssl_compression = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_ca_certificates_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_catalog_info = image:glance:publicURL {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_num_retries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance_request_timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] goodness_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] graceful_shutdown_timeout = 5 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] group_api_class = cinder.group.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] host = devstack {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_compress_on_upload = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_conversion_address_space_limit = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_conversion_cpu_limit = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_conversion_disable = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_upload_use_cinder_backend = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_upload_use_internal_tenant = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_volume_cache_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_volume_cache_max_count = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] image_volume_cache_max_size_gb = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] init_host_max_objects_retrieval = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] instance_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] iscsi_target_flags = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] iscsi_write_cache = on {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] iser_helper = tgtadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] iser_ip_address = 192.168.122.16 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] iser_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_color = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_config_append = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_dir = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_options = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_rotate_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_rotate_interval_type = days {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] log_rotation_type = none {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] max_age = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] max_logfile_count = 30 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] max_logfile_size_mb = 200 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] max_over_subscription_ratio = 20.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] message_reap_interval = 86400 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] message_ttl = 2592000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] migration_create_volume_timeout_secs = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] monkey_patch = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] monkey_patch_modules = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] my_ip = 192.168.122.16 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] no_snapshot_gb_quota = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] num_iser_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] num_shell_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] num_volume_device_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] nvmeof_conn_info_version = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] nvmet_ns_id = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] nvmet_port_id = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_max_limit = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_volume_ext_list = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_volume_listen_port = 8776 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_volume_use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] osapi_volume_workers = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] per_volume_size_limit = -1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] periodic_fuzzy_delay = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] periodic_interval = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Starting volume driver QuobyteDriver (1.1.14) Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] public_endpoint = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81991) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] publish_errors = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_backup_gigabytes = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_backups = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_gigabytes = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_groups = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_snapshots = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] quota_volumes = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] rate_limit_burst = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] rate_limit_except_level = CRITICAL {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] rate_limit_interval = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] reinit_driver_count = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] replication_device = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] report_discard_supported = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] report_interval = 120 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] reservation_clean_interval = 86400 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] reservation_expire = 86400 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] reserved_image_namespaces = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] reserved_percentage = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] rpc_response_timeout = 120 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] run_external_periodic_tasks = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] scst_target_driver = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] scst_target_iqn_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_down_time = 720 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] shell_completion = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] snapshot_name_template = snapshot-%s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] state_path = /opt/stack/data/cinder {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] storage_availability_zone = nova {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] storage_protocol = iSCSI {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] syslog_log_facility = LOG_USER {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] target_helper = lioadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] target_ip_address = 192.168.122.16 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] target_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] target_protocol = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] target_secondary_ip_addresses = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] trace_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] transport_url = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] until_refresh = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_chap_auth = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_default_quota_class = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_journal = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_json = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_stderr = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] use_syslog = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] verify_glance_signatures = enabled {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_api_class = cinder.volume.api.API {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_backend_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_clear = zero {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_clear_ionice = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_clear_size = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_copy_bps_limit = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_dd_blocksize = 1M {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_name_template = volume-%s {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_service_inithost_offload = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volume_usage_audit_period = month {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] zoning_mode = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_concurrency.disable_process_locking = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.admin_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.admin_token = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.admin_user = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_port = 35357 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_protocol = https {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_type = password {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_uri = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.auth_version = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.cache = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.identity_uri = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.include_service_catalog = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.interface = public {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_password = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcache_username = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.region_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.service_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.16/identity {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.backend = dogpile.cache.null {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.backend_argument = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.backend_expiration_time = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.config_prefix = cache.oslo {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.debug_cache_backend = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.enable_retry_client = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.enable_socket_keepalive = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.enforce_fips_mode = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.expiration_time = 600 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.hashclient_retry_attempts = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_dead_retry = 300 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_pool_maxsize = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_sasl_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.proxies = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.redis_db = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.redis_server = localhost:6379 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.retry_attempts = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.retry_delay = 0.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.socket_keepalive_count = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.socket_keepalive_idle = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.socket_keepalive_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.socket_timeout = 1.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.tls_allowed_ciphers = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.tls_cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.tls_certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.tls_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.tls_keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cache.username = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] coordination.backend_url = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.asyncio_connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.asyncio_slave_connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.backend = sqlalchemy {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.connection_debug = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.connection_parameters = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.connection_recycle_time = 3600 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.connection_trace = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.db_inc_retry_interval = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.db_max_retries = 20 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.db_max_retry_interval = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.db_retry_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.max_overflow = 50 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.max_pool_size = 5 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.max_retries = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.mysql_wsrep_sync_wait = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.pool_timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.retry_interval = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.slave_connection = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.sqlite_synchronous = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.synchronous_reader = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] database.use_db_reconnect = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.connection_string = messaging:// {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.es_doc_type = notification {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.es_scroll_size = 10000 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.es_scroll_time = 2m {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.filter_error_trace = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.hmac_keys = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.sentinel_service_name = mymaster {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.socket_timeout = 0.1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.trace_requests = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler.trace_sqlalchemy = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler_jaeger.process_tags = {} {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler_jaeger.service_name_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] profiler_otlp.service_name_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.enforce_new_defaults = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: WARNING oslo_config.cfg [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.enforce_scope = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.policy_default_rule = default {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.policy_file = policy.yaml {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.group = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.helper_command = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] privsep_osbrick.user = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.group = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.helper_command = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] cinder_sys_admin.user = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.auth_type = password {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81991) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.send_service_user_token = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] service_user.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.auth_type = password {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Running cmd (subprocess): mount.quobyte {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.region_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] glance.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.backend_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.chap_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.chap_username = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.disk_geometry = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.driver_client_cert = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.driver_client_cert_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.driver_data_namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.driver_use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.extra_capabilities = {} {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.filter_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.goodness_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.iscsi_target_flags = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.iscsi_write_cache = on {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.iser_helper = tgtadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.iser_ip_address = 192.168.122.16 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.iser_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_host = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_login = admin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_mount_options = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_private_key = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_share_path = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.num_shell_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.quobyte_volume_url = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.replication_device = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.report_discard_supported = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.reserved_percentage = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.target_helper = tgtadm {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.target_ip_address = 192.168.122.16 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.target_port = 3260 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.target_protocol = iscsi {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.trace_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.unique_fqdn_network = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.use_chap_auth = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_backend_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_clear = zero {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_clear_ionice = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_clear_size = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_reports.file_event_handler = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_reports.log_dir = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.backend_availability_zone = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.backend_host = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.chap_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.chap_username = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.chiscsi_conf = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.disk_geometry = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.driver_client_cert = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.driver_data_namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.driver_use_ssl = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.extra_capabilities = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.filter_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.goodness_function = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.iser_helper = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.iser_ip_address = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.iser_port = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.iser_target_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_host = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_login = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_mount_options = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_password = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_private_key = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_share_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_ssh_port = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.num_shell_tries = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.nvmet_port_id = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.replication_device = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.report_discard_supported = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.reserved_percentage = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.scst_target_driver = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.storage_protocol = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.target_helper = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.target_ip_address = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.target_port = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.target_prefix = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.target_protocol = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.trace_flags = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.use_chap_auth = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_clear = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_clear_size = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] QuobyteHD.volumes_dir = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack quobyte-client[82005]: Reading configuration file: /etc/quobyte/client.cfg Apr 21 20:49:57 devstack quobyte-client[82005]: Invalid parameters found, error: missing mount point. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack quobyte-client[82005]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack quobyte-client[82005]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_notifications.driver = [] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_notifications.retry = -1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] CMD "mount.quobyte" returned: 1 in 0.049s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] key_manager.fixed_key = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.barbican_api_version = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.barbican_endpoint = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.barbican_endpoint_type = public {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.barbican_region_name = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.number_of_retries = 60 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.retry_delay = 1 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.send_service_user_token = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.verify_ssl = True {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican.verify_ssl_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.auth_section = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.auth_type = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.cafile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.certfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.collect_timing = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.insecure = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.keyfile = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.split_loggers = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] barbican_service_user.timeout = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.approle_role_id = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.approle_secret_id = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.kv_mountpoint = secret {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.kv_path = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.kv_version = 2 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.namespace = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.root_token_id = **** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.ssl_ca_crt_file = None {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.timeout = 60.0 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.use_ssl = False {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 21 20:49:57 devstack cinder-volume[81855]: DEBUG oslo_service.backend._eventlet.service [None req-9a5624d7-f379-4334-908b-d86852c4bda3 None None] ******************************************************************************** {{(pid=81855) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 21 20:49:57 devstack sudo[82021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:57 devstack sudo[82021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:58 devstack sudo[82021]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.376s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.volume.driver [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Driver hasn't implemented _init_vendor_properties() Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.volume.driver [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81991) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_db.sqlalchemy.engines [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writer thread running {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.db.sqlalchemy.api [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Building query based on filter {{(pid=81991) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81991) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.keymgr.migration [None req-b3106f07-7bed-4f4e-9ff1-d47138183b18 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 21 20:49:58 devstack sudo[82058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:58 devstack sudo[82058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:58 devstack sudo[82058]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.380s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Driver initialization completed successfully. Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Initiating service 3 cleanup Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Service 3 cleanup completed. Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.service [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Creating RPC server for service cinder-volume {{(pid=81991) start /opt/stack/cinder/cinder/service.py:231}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.service [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81991) start /opt/stack/cinder/cinder/service.py:237}} Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:49:58 devstack sudo[82078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:49:58 devstack sudo[82078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:49:58 devstack sudo[82078]: pam_unix(sudo:session): session closed for user root Apr 21 20:49:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.396s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:49:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-62ed6435-0b59-47be-b834-78415081cb5a None None] Driver post RPC initialization completed successfully. Apr 21 20:50:07 devstack cinder-volume[81855]: DEBUG dbcounter [-] [81855] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81855) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:50:08 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=2 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:50:08 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Flow 'volume_create_manager' (a9eea17d-d009-46df-9cde-c0586d8deb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc50818-df9f-423e-8b0a-e3fce3704bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc50818-df9f-423e-8b0a-e3fce3704bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1900468142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932e37a8-192b-4d77-8c7a-f2bb61f3d7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93552696f2e84a81a5354898efb618e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:50:54Z,use_quota=True,user_id='f60cee8c2bd3450eb0259ea28311d43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c69658a-5d75-45d4-8331-57bdad54dac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c69658a-5d75-45d4-8331-57bdad54dac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7075b37-fbf3-4d47-b2af-67de1effa0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7075b37-fbf3-4d47-b2af-67de1effa0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '932e37a8-192b-4d77-8c7a-f2bb61f3d7d3', 'volume_name': 'volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9a9088-ba5c-4a12-b3c8-813c935876df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9a9088-ba5c-4a12-b3c8-813c935876df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22962dbc-5ef0-433e-9dbb-7af9ab51d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3', 'volume_size': 1} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1900468142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=932e37a8-192b-4d77-8c7a-f2bb61f3d7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93552696f2e84a81a5354898efb618e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:50:54Z,use_quota=True,user_id='f60cee8c2bd3450eb0259ea28311d43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Creating volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:50:54 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:54 devstack sudo[82527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 1073741824 Apr 21 20:50:54 devstack sudo[82527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Flow 'volume_create_manager' (b07027c3-3b09-45fc-845b-bf7532bce4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b38c06-9db3-40c0-8f85-02c64d3b8d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b38c06-9db3-40c0-8f85-02c64d3b8d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-414527180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb3f0d3-b082-486d-9199-73c3a024717f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1d0c76988e4d5eba23df29536a9029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:50:55Z,use_quota=True,user_id='292dbcdf7dbb48729358ee5506e28c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6cdbdd-df20-4cb1-ba66-a1b2e1cb0696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6cdbdd-df20-4cb1-ba66-a1b2e1cb0696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080f1d0b-62a3-4c85-ab60-df544a76845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080f1d0b-62a3-4c85-ab60-df544a76845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb3f0d3-b082-486d-9199-73c3a024717f', 'volume_name': 'volume-7cb3f0d3-b082-486d-9199-73c3a024717f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941ee273-4d05-46f5-b91d-2af687aab133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941ee273-4d05-46f5-b91d-2af687aab133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81ee8b3-1a46-40f0-8261-c254a2fe0cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:55 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Volume 7cb3f0d3-b082-486d-9199-73c3a024717f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb3f0d3-b082-486d-9199-73c3a024717f', 'volume_size': 1} Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:55 devstack sudo[82527]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 1073741824" returned: 0 in 1.171s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:55 devstack sudo[82848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 Apr 21 20:50:55 devstack sudo[82848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:56 devstack sudo[82848]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" returned: 0 in 0.945s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-414527180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb3f0d3-b082-486d-9199-73c3a024717f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b1d0c76988e4d5eba23df29536a9029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:50:55Z,use_quota=True,user_id='292dbcdf7dbb48729358ee5506e28c2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Creating volume 7cb3f0d3-b082-486d-9199-73c3a024717f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:50:56 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22962dbc-5ef0-433e-9dbb-7af9ab51d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2c57f6-0cc1-4c03-ab4f-7ba83ae89a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:56 devstack sudo[82852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f 1073741824 Apr 21 20:50:56 devstack sudo[82852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:56 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Volume volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 (932e37a8-192b-4d77-8c7a-f2bb61f3d7d3): created successfully Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2c57f6-0cc1-4c03-ab4f-7ba83ae89a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Flow 'volume_create_manager' (a9eea17d-d009-46df-9cde-c0586d8deb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:50:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-61e7a4d7-8060-4a76-bceb-24e39fc0c9bd tempest-SnapshotsActionsTest-797172857 None] Created volume successfully. Apr 21 20:50:57 devstack sudo[82852]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f 1073741824" returned: 0 in 0.942s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:50:57 devstack sudo[82861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f Apr 21 20:50:57 devstack sudo[82861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:50:58 devstack sudo[82861]: pam_unix(sudo:session): session closed for user root Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f" returned: 0 in 0.713s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.313s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Creating offline snapshot 41dabff1-f207-417c-b777-9fcf41d17e86 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:50:58 devstack cinder-volume[81991]: INFO oslo.privsep.daemon [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmprmb2r4q1/privsep.sock'] Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81ee8b3-1a46-40f0-8261-c254a2fe0cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb3f0d3-b082-486d-9199-73c3a024717f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315606d1-2b5f-4cbf-9432-40d4c221297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:50:58 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Volume volume-7cb3f0d3-b082-486d-9199-73c3a024717f (7cb3f0d3-b082-486d-9199-73c3a024717f): created successfully Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315606d1-2b5f-4cbf-9432-40d4c221297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:50:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Flow 'volume_create_manager' (b07027c3-3b09-45fc-845b-bf7532bce4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:50:58 devstack sudo[82866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmprmb2r4q1/privsep.sock Apr 21 20:50:58 devstack sudo[82866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:50:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3f0ba990-e233-46ab-a974-03dba03776a7 tempest-VolumesAdminNegativeTest-361845614 None] Created volume successfully. Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: Apr 21 20:50:59 devstack cinder-volume[81991]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Acquiring lock "cinder-7cb3f0d3-b082-486d-9199-73c3a024717f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Lock "cinder-7cb3f0d3-b082-486d-9199-73c3a024717f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:00 devstack sudo[82866]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:00 devstack cinder-volume[81991]: INFO oslo.privsep.daemon [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Spawned new privsep daemon via rootwrap Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Accepted privsep connection to /tmp/tmprmb2r4q1/privsep.sock {{(pid=81991) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Acquiring lock "cinder-quobyte-7cb3f0d3-b082-486d-9199-73c3a024717f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:00 devstack cinder-volume[81991]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 21 20:51:00 devstack cinder-volume[81991]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 21 20:51:00 devstack cinder-volume[81991]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 21 20:51:00 devstack cinder-volume[81991]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82872 Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda5fc0e-0cbc-47f4-bfcb-1455f294b615]: (2,) {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Lock "cinder-quobyte-7cb3f0d3-b082-486d-9199-73c3a024717f" acquired by "delete_volume" :: waited 0.044s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[208f5bd0-f7b4-4db6-91ba-fb35705da74f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff357c99-a1a4-4b2b-b80a-2fbd17d7609b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:00 devstack sudo[82875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 Apr 21 20:51:00 devstack sudo[82875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:00 devstack sudo[82876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f Apr 21 20:51:00 devstack sudo[82876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:01 devstack sudo[82876]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f" returned: 0 in 1.247s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:01 devstack sudo[82885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f Apr 21 20:51:01 devstack sudo[82885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:02 devstack sudo[82875]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" returned: 0 in 1.405s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:02 devstack sudo[82887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 1G Apr 21 20:51:02 devstack sudo[82887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:02 devstack sudo[82885]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7cb3f0d3-b082-486d-9199-73c3a024717f" returned: 0 in 0.890s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Lock "cinder-quobyte-7cb3f0d3-b082-486d-9199-73c3a024717f" released by "delete_volume" :: held 2.246s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:02 devstack cinder-volume[81991]: WARNING cinder.quota [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:51:02 devstack cinder-volume[81991]: WARNING cinder.quota [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:51:02 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Created reservations ['8106da75-c18a-46b1-ad0f-3d159f2805f8', 'a64ac883-339f-46b8-b350-b6e6665e5f43', 'bb2424fc-aaae-4db4-883f-2a146b3640bd', 'afe05be1-fac6-4e32-a44e-1610b212a656'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:03 devstack sudo[82894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:51:03 devstack sudo[82894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:03 devstack sudo[82887]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 1G" returned: 0 in 1.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:03 devstack sudo[82896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:03 devstack sudo[82896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:04 devstack sudo[82894]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 1.640s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:04 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Deleted volume successfully. Apr 21 20:51:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-087d1867-6b3f-44be-a560-7bd6f34fd91e tempest-VolumesAdminNegativeTest-361845614 None] Lock "cinder-7cb3f0d3-b082-486d-9199-73c3a024717f-delete_volume" released by "delete_volume" :: held 4.533s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:05 devstack sudo[82896]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 2.052s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:05 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 is being set with open permissions: ugo+rw Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:05 devstack sudo[82931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:05 devstack sudo[82931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Flow 'volume_create_manager' (7fdb3e57-183b-41a0-b422-6301888dfdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74de405-9ff5-4a60-91a0-6af4651b7c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74de405-9ff5-4a60-91a0-6af4651b7c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:05Z,deleted=False,deleted_at=None,display_description='',display_name='b0445628-9ea2-4a5f-a35f-0155b9f650db-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97777c1-10fd-482c-8d22-8230f0189e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a16c1e42a14cbdbeb48b46bf4456bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:06Z,use_quota=True,user_id='b5568b8d85d04d149620893db3747a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18926dae-2ddd-43f8-a012-5cf66b7a4902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18926dae-2ddd-43f8-a012-5cf66b7a4902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2048d658-c73a-47af-808c-24b6e647361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2048d658-c73a-47af-808c-24b6e647361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97777c1-10fd-482c-8d22-8230f0189e22', 'volume_name': 'volume-e97777c1-10fd-482c-8d22-8230f0189e22', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9cf611-d994-4b70-81f0-ff5a7c857595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9cf611-d994-4b70-81f0-ff5a7c857595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60791db4-6f6a-4f77-8771-e5f3b280c055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:05 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Volume e97777c1-10fd-482c-8d22-8230f0189e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97777c1-10fd-482c-8d22-8230f0189e22', 'volume_size': 1} Apr 21 20:51:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:06 devstack sudo[82931]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.947s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:06 devstack sudo[82944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info Apr 21 20:51:06 devstack sudo[82944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:07 devstack sudo[82944]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info" returned: 0 in 0.688s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:07 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info is being set with open permissions: ugo+rw Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:07 devstack sudo[82956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info Apr 21 20:51:07 devstack sudo[82956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:07 devstack sudo[82956]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.info" returned: 0 in 0.560s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.290s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.071s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:05Z,deleted=False,deleted_at=None,display_description='',display_name='b0445628-9ea2-4a5f-a35f-0155b9f650db-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97777c1-10fd-482c-8d22-8230f0189e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a16c1e42a14cbdbeb48b46bf4456bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:06Z,use_quota=True,user_id='b5568b8d85d04d149620893db3747a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Creating volume e97777c1-10fd-482c-8d22-8230f0189e22 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:07 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:51:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:07 devstack sudo[82962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 1073741824 Apr 21 20:51:07 devstack sudo[82962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:07 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c2c8da43-213f-47a5-908f-4c5b58f0c06b tempest-SnapshotsActionsTest-797172857 None] Create snapshot completed successfully Apr 21 20:51:08 devstack sudo[82962]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 1073741824" returned: 0 in 0.734s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:08 devstack sudo[82978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 Apr 21 20:51:08 devstack sudo[82978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:09 devstack sudo[82978]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22" returned: 0 in 0.523s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60791db4-6f6a-4f77-8771-e5f3b280c055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97777c1-10fd-482c-8d22-8230f0189e22', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f07b1e-6392-4e4a-9627-c583ec13f654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:09 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Volume volume-e97777c1-10fd-482c-8d22-8230f0189e22 (e97777c1-10fd-482c-8d22-8230f0189e22): created successfully Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f07b1e-6392-4e4a-9627-c583ec13f654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Flow 'volume_create_manager' (7fdb3e57-183b-41a0-b422-6301888dfdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-36c5c0f7-2eb2-4738-abf5-969919275e0d tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Created volume successfully. Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Creating offline snapshot 93971520-16cd-41c6-a19f-4131022ef827 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[95442db5-ce7c-4751-bad0-b5fc9b12b039]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:09 devstack sudo[82981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:09 devstack sudo[82981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:09 devstack sudo[82981]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.479s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:09 devstack sudo[82986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 1G Apr 21 20:51:09 devstack sudo[82986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:10 devstack sudo[82986]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 1G" returned: 0 in 0.604s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:10 devstack sudo[82991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 Apr 21 20:51:10 devstack sudo[82991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:11 devstack sudo[82991]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827" returned: 0 in 0.609s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:11 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 is being set with open permissions: ugo+rw Apr 21 20:51:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:11 devstack sudo[83032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 Apr 21 20:51:11 devstack sudo[83032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:11 devstack sudo[83032]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6d2e496f-46fa-44b6-b557-022d24be9d98 tempest-SnapshotsActionsTest-797172857 None] Create snapshot completed successfully Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-93971520-16cd-41c6-a19f-4131022ef827-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-93971520-16cd-41c6-a19f-4131022ef827-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-93971520-16cd-41c6-a19f-4131022ef827" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-93971520-16cd-41c6-a19f-4131022ef827" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Deleting offline snapshot 93971520-16cd-41c6-a19f-4131022ef827 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] snapshot_file for this snap is: volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7c6c8-4697-4d60-a872-9b6aa42fdcae]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:12 devstack sudo[83040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 Apr 21 20:51:12 devstack sudo[83040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:13 devstack sudo[83040]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827" returned: 0 in 0.610s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:13 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a88bb9-8fbc-42ac-b25b-f61993aa8579]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:13 devstack sudo[83053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:13 devstack sudo[83053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:13 devstack cinder-volume[81991]: WARNING py.warnings [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 21 20:51:13 devstack cinder-volume[81991]: .first() Apr 21 20:51:13 devstack cinder-volume[81991]: Apr 21 20:51:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b967aa06-bd30-4a3d-a7e3-cdf6064f64b1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:14 devstack sudo[83076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 Apr 21 20:51:14 devstack sudo[83076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:14 devstack sudo[83053]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.858s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:14 devstack sudo[83081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 Apr 21 20:51:14 devstack sudo[83081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:14 devstack sudo[83076]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22" returned: 0 in 0.580s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.592s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc', 'name': 'volume-e97777c1-10fd-482c-8d22-8230f0189e22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60115091-69c9-4b06-95f2-ab9d70b24be8', 'enforce_multipath': True} {{(pid=81991) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:51:14 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-eca9b769-59c0-4a1f-b79f-d973e76aed0a req-8bf499a0-74a0-4151-b03f-44d3206f0507 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] attachment_update completed successfully. Apr 21 20:51:15 devstack sudo[83081]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827" returned: 0 in 0.678s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:15 devstack sudo[83090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827 Apr 21 20:51:15 devstack sudo[83090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:15 devstack sudo[83090]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.93971520-16cd-41c6-a19f-4131022ef827" returned: 0 in 0.585s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-93971520-16cd-41c6-a19f-4131022ef827" released by "_delete_snapshot" :: held 2.813s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" released by "delete_snapshot" :: held 2.830s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:15 devstack cinder-volume[81991]: WARNING cinder.quota [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Created reservations ['c98d0f33-b075-440e-958a-40fc3e294404', '95540b77-0ee8-4a26-a030-7e843eebf792', '0f6d2c99-b132-419b-9424-e8366d1675da', '01ac268f-8ff3-436c-b13d-70acb7e477bd'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Delete snapshot completed successfully. Apr 21 20:51:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b119fdb2-87a7-46b1-a8ed-cfc6199741d5 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-93971520-16cd-41c6-a19f-4131022ef827-delete_snapshot" released by "delete_snapshot" :: held 2.948s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Creating offline snapshot 7f6cc6b8-a6d9-4654-86b5-a53c88be0786 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:51:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af0967c-bffe-48e7-bb91-9326792f92ef]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:16 devstack sudo[83097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:16 devstack sudo[83097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:17 devstack sudo[83097]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.658s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:17 devstack sudo[83171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 1G Apr 21 20:51:17 devstack sudo[83171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:17 devstack sudo[83171]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 1G" returned: 0 in 0.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:17 devstack sudo[83176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 Apr 21 20:51:17 devstack sudo[83176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:18 devstack sudo[83176]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786" returned: 0 in 0.662s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:18 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 is being set with open permissions: ugo+rw Apr 21 20:51:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:18 devstack sudo[83209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 Apr 21 20:51:18 devstack sudo[83209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:18 devstack sudo[83209]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786" returned: 0 in 0.643s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c612d585-8cf5-4087-b914-7160e167e996 tempest-SnapshotsActionsTest-797172857 None] Create snapshot completed successfully Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-7f6cc6b8-a6d9-4654-86b5-a53c88be0786-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-7f6cc6b8-a6d9-4654-86b5-a53c88be0786-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-7f6cc6b8-a6d9-4654-86b5-a53c88be0786" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-7f6cc6b8-a6d9-4654-86b5-a53c88be0786" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Deleting offline snapshot 7f6cc6b8-a6d9-4654-86b5-a53c88be0786 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] snapshot_file for this snap is: volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9311b1-a008-450b-887a-e78db410721b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:19 devstack sudo[83546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 Apr 21 20:51:19 devstack sudo[83546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:20 devstack sudo[83546]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786" returned: 0 in 0.586s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:20 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0efc87e-4f4b-40d1-9fb6-f1d9863cb543]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:20 devstack sudo[83559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:20 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:21 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.847s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:21 devstack sudo[83567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 Apr 21 20:51:21 devstack sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:21 devstack sudo[83567]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786" returned: 0 in 0.631s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:22 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786 Apr 21 20:51:22 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:22 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.7f6cc6b8-a6d9-4654-86b5-a53c88be0786" returned: 0 in 0.659s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-7f6cc6b8-a6d9-4654-86b5-a53c88be0786" released by "_delete_snapshot" :: held 2.816s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" released by "delete_snapshot" :: held 2.832s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:22 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Created reservations ['5c4cbc94-2983-4ac9-8af2-1c0696ce408c', '31a85024-41d6-4e8e-b1a3-b61d352bfd31', 'b47d49b2-e867-4cbb-bac2-76ea1ecc7a6c', '5b55c5d4-4de0-41b4-90af-0f632762e0ed'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Delete snapshot completed successfully. Apr 21 20:51:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b8c78448-bf43-46b3-ad33-d79dcf8845e4 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-7f6cc6b8-a6d9-4654-86b5-a53c88be0786-delete_snapshot" released by "delete_snapshot" :: held 2.947s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Creating offline snapshot eec00775-d713-4b0e-b1cd-7b5f60c571b0 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a935fdf3-2df4-44a7-92cf-37cb6a05862f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:23 devstack sudo[83583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:23 devstack sudo[83583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:23 devstack sudo[83583]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.617s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:23 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 1G Apr 21 20:51:23 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:24 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 1G" returned: 0 in 0.731s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:24 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 Apr 21 20:51:24 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:25 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0" returned: 0 in 0.595s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:25 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 is being set with open permissions: ugo+rw Apr 21 20:51:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:25 devstack sudo[83600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 Apr 21 20:51:25 devstack sudo[83600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:25 devstack sudo[83600]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0" returned: 0 in 0.470s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:25 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-45ee25e0-c039-40f0-a5e0-cf9471612a31 tempest-SnapshotsActionsTest-797172857 None] Create snapshot completed successfully Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-eec00775-d713-4b0e-b1cd-7b5f60c571b0-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-eec00775-d713-4b0e-b1cd-7b5f60c571b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-eec00775-d713-4b0e-b1cd-7b5f60c571b0" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-eec00775-d713-4b0e-b1cd-7b5f60c571b0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Deleting offline snapshot eec00775-d713-4b0e-b1cd-7b5f60c571b0 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] snapshot_file for this snap is: volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60424e-27ff-4c7c-a341-eee8dccbd7a6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:26 devstack sudo[83605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 Apr 21 20:51:26 devstack sudo[83605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:28 devstack sudo[83605]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0" returned: 0 in 1.590s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb9b4fc-ec01-42e8-bbbc-397dffb67820]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:28 devstack sudo[83635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:28 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:29 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 1.133s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:29 devstack sudo[83670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 Apr 21 20:51:29 devstack sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:30 devstack sudo[83670]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0" returned: 0 in 0.706s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:30 devstack sudo[83682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0 Apr 21 20:51:30 devstack sudo[83682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:30 devstack sudo[83682]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.eec00775-d713-4b0e-b1cd-7b5f60c571b0" returned: 0 in 0.528s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-eec00775-d713-4b0e-b1cd-7b5f60c571b0" released by "_delete_snapshot" :: held 4.035s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" released by "delete_snapshot" :: held 4.058s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Created reservations ['eb17ef93-a213-46d2-bef7-237ee5f92d10', '0b8b7fbd-0d2c-45ce-bbdf-968cdae8faed', '43db9e59-2e18-450f-8f09-1c5bc8fb2f91', 'cada896a-7222-4287-ab8c-c4cb2038f077'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:30 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Delete snapshot completed successfully. Apr 21 20:51:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-50e6cebe-27d6-45ed-9352-713ad338a8ab tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-eec00775-d713-4b0e-b1cd-7b5f60c571b0-delete_snapshot" released by "delete_snapshot" :: held 4.216s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Creating offline snapshot 55813d03-8d2c-4d5b-a652-9700b3301179 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[92623d7d-57af-47ee-82ad-3df73f344a67]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:32 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:32 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:32 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.693s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:32 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 1G Apr 21 20:51:32 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:33 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 1G" returned: 0 in 1.038s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:33 devstack sudo[83760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 Apr 21 20:51:33 devstack sudo[83760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:34 devstack sudo[83760]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179" returned: 0 in 0.943s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:34 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 is being set with open permissions: ugo+rw Apr 21 20:51:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:34 devstack sudo[83768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 Apr 21 20:51:34 devstack sudo[83768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:36 devstack sudo[83768]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179" returned: 0 in 1.357s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.220s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:36 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ccd07977-5485-48ac-921b-e9eb4cbb4985 tempest-SnapshotsActionsTest-797172857 None] Create snapshot completed successfully Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-55813d03-8d2c-4d5b-a652-9700b3301179-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-55813d03-8d2c-4d5b-a652-9700b3301179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Acquiring lock "cinder-quobyte-55813d03-8d2c-4d5b-a652-9700b3301179" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-55813d03-8d2c-4d5b-a652-9700b3301179" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Deleting offline snapshot 55813d03-8d2c-4d5b-a652-9700b3301179 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] snapshot_file for this snap is: volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[406cde34-eec1-40fd-ab8a-558c670ef9e1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:38 devstack sudo[83802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 Apr 21 20:51:38 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:39 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179" returned: 0 in 1.343s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e7002d-9bd6-4c90-9a04-e54d06a5eb02]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:39 devstack sudo[83835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:39 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:40 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.988s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:40 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 Apr 21 20:51:40 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:41 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179" returned: 0 in 0.869s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:41 devstack sudo[83895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179 Apr 21 20:51:41 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:41 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.55813d03-8d2c-4d5b-a652-9700b3301179" returned: 0 in 0.639s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-55813d03-8d2c-4d5b-a652-9700b3301179" released by "_delete_snapshot" :: held 4.029s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" released by "delete_snapshot" :: held 4.058s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:41 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Created reservations ['d9fad75e-d149-4a87-b6aa-14cfa562db32', 'b4e7e46b-7960-4ca9-99c1-ec9b881a0c66', '0a267c51-9603-4a24-8f57-664c8794ca6d', 'e244f9d7-2ac5-4ca3-8c1e-192ac9fbf93d'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Delete snapshot completed successfully. Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d53e7440-0331-46a2-ac14-f5aa3f217346 tempest-SnapshotsActionsTest-2017934920 None] Lock "cinder-55813d03-8d2c-4d5b-a652-9700b3301179-delete_snapshot" released by "delete_snapshot" :: held 4.282s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "cinder-41dabff1-f207-417c-b777-9fcf41d17e86-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-41dabff1-f207-417c-b777-9fcf41d17e86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "cinder-quobyte-41dabff1-f207-417c-b777-9fcf41d17e86" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-quobyte-41dabff1-f207-417c-b777-9fcf41d17e86" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Deleting offline snapshot 41dabff1-f207-417c-b777-9fcf41d17e86 of volume 932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] snapshot_file for this snap is: volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed4d0c-dd8f-49ad-a906-c9dc155aabb5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:42 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:42 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:43 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.666s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:51:43 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[079be752-9248-4405-9440-6fbebc2fff77]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:43 devstack sudo[83916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 Apr 21 20:51:43 devstack sudo[83916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:43 devstack sudo[83916]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" returned: 0 in 0.703s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:43 devstack sudo[83932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:43 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:44 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.505s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:44 devstack sudo[83939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86 Apr 21 20:51:44 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:44 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Flow 'volume_create_manager' (f546092a-0c12-46a7-9eec-d9caa8c3ca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db045ce-9585-461c-a4c7-baec3163e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db045ce-9585-461c-a4c7-baec3163e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-574527945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c455bbe-7192-4666-bb44-791a4a5899b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028bc962c55b4842a6b21a5ee47a14c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:45Z,use_quota=True,user_id='904ece364414447bbcb14c8109551a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd47cdcd-44c5-47f2-81ad-440b414a4252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd47cdcd-44c5-47f2-81ad-440b414a4252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6363ba-6a5b-4928-b6d4-0275f0e0d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6363ba-6a5b-4928-b6d4-0275f0e0d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c455bbe-7192-4666-bb44-791a4a5899b8', 'volume_name': 'volume-3c455bbe-7192-4666-bb44-791a4a5899b8', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612a3a70-5f79-4035-9f8a-bb3133bc449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612a3a70-5f79-4035-9f8a-bb3133bc449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:45 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cc3a69-bb94-4719-8154-19cb15e8b4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Volume 3c455bbe-7192-4666-bb44-791a4a5899b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c455bbe-7192-4666-bb44-791a4a5899b8', 'volume_size': 1} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-574527945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c455bbe-7192-4666-bb44-791a4a5899b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028bc962c55b4842a6b21a5ee47a14c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:45Z,use_quota=True,user_id='904ece364414447bbcb14c8109551a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Creating volume 3c455bbe-7192-4666-bb44-791a4a5899b8 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:45 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3.41dabff1-f207-417c-b777-9fcf41d17e86" returned: 0 in 0.629s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:45 devstack sudo[83946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 1073741824 Apr 21 20:51:45 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-quobyte-41dabff1-f207-417c-b777-9fcf41d17e86" released by "_delete_snapshot" :: held 2.613s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" released by "delete_snapshot" :: held 2.632s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Created reservations ['a79538d9-2b1e-4b98-820c-262fc961d17b', '273e427f-a8b0-4ffe-b9ae-026cfb17e9ea', '4065ab51-34d8-43d0-847b-aca77f40684c', 'fc49f778-47a3-4ea8-8163-354902c36626'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Delete snapshot completed successfully. Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-640eb3a7-096a-4f48-9154-a85424f1faca tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-41dabff1-f207-417c-b777-9fcf41d17e86-delete_snapshot" released by "delete_snapshot" :: held 2.741s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:45 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 1073741824" returned: 0 in 0.520s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:45 devstack sudo[83951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 Apr 21 20:51:45 devstack sudo[83951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "cinder-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8cf6b3-d46d-4bbf-aa6a-4711c736bdf6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:45 devstack sudo[83955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 Apr 21 20:51:45 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:46 devstack sudo[83951]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8" returned: 0 in 0.794s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cc3a69-bb94-4719-8154-19cb15e8b4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c455bbe-7192-4666-bb44-791a4a5899b8', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba907e60-4a26-4e7a-88fc-49b95c1b5df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:46 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Volume volume-3c455bbe-7192-4666-bb44-791a4a5899b8 (3c455bbe-7192-4666-bb44-791a4a5899b8): created successfully Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba907e60-4a26-4e7a-88fc-49b95c1b5df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Flow 'volume_create_manager' (f546092a-0c12-46a7-9eec-d9caa8c3ca29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:46 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-32a65f14-c268-4acc-b70a-30f5c892311d tempest-ServersNegativeTestJSON-1096159787 None] Created volume successfully. Apr 21 20:51:46 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" returned: 0 in 0.778s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:46 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3 Apr 21 20:51:46 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:47 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" returned: 0 in 0.484s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-quobyte-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3" released by "delete_volume" :: held 1.307s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Created reservations ['ea8abaa5-c1c4-4f69-a830-13fc1471f8fa', 'b1016d6a-8cae-45f0-a2fc-c914f007b2b8', 'a425249f-1b68-4308-8644-3d27c8288a28', '30f25593-a0c6-4793-8d81-8e6a5d65dc9d'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:47 devstack sudo[83981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:51:47 devstack sudo[83981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:47 devstack sudo[83981]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.639s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:47 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Deleted volume successfully. Apr 21 20:51:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e0180f46-5042-4611-a971-c6056fbb469f tempest-SnapshotsActionsTest-797172857 None] Lock "cinder-932e37a8-192b-4d77-8c7a-f2bb61f3d7d3-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=65,cinder:UPDATE=68,cinder:INSERT=19,cinder:DELETE=3 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Flow 'volume_create_manager' (33049630-69fe-443b-a945-8448857ebb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bcf879-a7c8-4500-9997-0fbcf1ee8fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bcf879-a7c8-4500-9997-0fbcf1ee8fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1652771525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d779cf4d-11a3-434f-a000-3ecdabf528a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028bc962c55b4842a6b21a5ee47a14c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:49Z,use_quota=True,user_id='904ece364414447bbcb14c8109551a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c97c4ab-2e17-4503-83b8-a36993e920ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c97c4ab-2e17-4503-83b8-a36993e920ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df35dbbd-e452-4e5c-8a8c-a6abc0a50b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df35dbbd-e452-4e5c-8a8c-a6abc0a50b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd779cf4d-11a3-434f-a000-3ecdabf528a2', 'volume_name': 'volume-d779cf4d-11a3-434f-a000-3ecdabf528a2', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e09945-2c89-4b53-afce-019712075f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e09945-2c89-4b53-afce-019712075f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d3f3ba-7638-4072-bff9-cd4c1df21e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:48 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Volume d779cf4d-11a3-434f-a000-3ecdabf528a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d779cf4d-11a3-434f-a000-3ecdabf528a2', 'volume_size': 1} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1652771525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d779cf4d-11a3-434f-a000-3ecdabf528a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028bc962c55b4842a6b21a5ee47a14c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:49Z,use_quota=True,user_id='904ece364414447bbcb14c8109551a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Creating volume d779cf4d-11a3-434f-a000-3ecdabf528a2 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:48 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:51:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:48 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 1073741824 Apr 21 20:51:48 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:49 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 1073741824" returned: 0 in 0.834s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:49 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=58,cinder:DELETE=8,cinder:INSERT=14,cinder:SELECT=59 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:51:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:49 devstack sudo[84007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 Apr 21 20:51:49 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:50 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2" returned: 0 in 0.806s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d3f3ba-7638-4072-bff9-cd4c1df21e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d779cf4d-11a3-434f-a000-3ecdabf528a2', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3773592f-9d69-4e2e-bf4f-b739fbebd76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:50 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Volume volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 (d779cf4d-11a3-434f-a000-3ecdabf528a2): created successfully Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3773592f-9d69-4e2e-bf4f-b739fbebd76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Flow 'volume_create_manager' (33049630-69fe-443b-a945-8448857ebb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-79d3c404-e6a6-4cfa-97df-21f39b1ba208 tempest-ServersNegativeTestJSON-1096159787 None] Created volume successfully. Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "cinder-d779cf4d-11a3-434f-a000-3ecdabf528a2-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-d779cf4d-11a3-434f-a000-3ecdabf528a2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "cinder-quobyte-d779cf4d-11a3-434f-a000-3ecdabf528a2" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-quobyte-d779cf4d-11a3-434f-a000-3ecdabf528a2" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef06671-3ea8-4d5b-8e1c-ce3b80bd4413]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:51 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 Apr 21 20:51:51 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:52 devstack sudo[84031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:51:52 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:52 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2" returned: 0 in 0.788s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:52 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2 Apr 21 20:51:52 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:52 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d779cf4d-11a3-434f-a000-3ecdabf528a2" returned: 0 in 0.692s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-quobyte-d779cf4d-11a3-434f-a000-3ecdabf528a2" released by "delete_volume" :: held 1.517s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:52 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 1.010s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:52 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Created reservations ['c731afc2-166f-4d15-a7ea-7909df655ada', '8dfd8f93-7925-442c-98be-c60d5f304c06', '6526450e-6d0c-4b78-90b9-f06178072791', '240b8e14-dc05-4850-a80b-6c891c61248f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:53 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:51:53 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:53 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.459s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Deleted volume successfully. Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-34a1badb-8415-4c8c-8fd5-fea5b10c1944 tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-d779cf4d-11a3-434f-a000-3ecdabf528a2-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "cinder-3c455bbe-7192-4666-bb44-791a4a5899b8-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-3c455bbe-7192-4666-bb44-791a4a5899b8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "cinder-quobyte-3c455bbe-7192-4666-bb44-791a4a5899b8" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-quobyte-3c455bbe-7192-4666-bb44-791a4a5899b8" acquired by "delete_volume" :: waited 0.020s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[beebfbda-2669-4cf1-a78f-b662d74812e1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:51:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:54 devstack sudo[84069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 Apr 21 20:51:54 devstack sudo[84069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:54 devstack sudo[84069]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8" returned: 0 in 0.991s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:54 devstack sudo[84085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8 Apr 21 20:51:54 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:55 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3c455bbe-7192-4666-bb44-791a4a5899b8" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-quobyte-3c455bbe-7192-4666-bb44-791a4a5899b8" released by "delete_volume" :: held 1.495s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Created reservations ['4368fd3d-aaa5-44e5-ba41-a9178c59fd09', '7402bae6-3052-402e-94fe-fd834da1f970', '5e95c97d-3fb5-4c03-afd6-73268425b35b', '6cf30dda-622c-4e74-8429-819a64f99c3f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:55 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:51:55 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:56 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 1.092s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:56 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:51:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Deleted volume successfully. Apr 21 20:51:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-35be0a6c-a60a-4b2e-a2a6-b629d2c556bc tempest-ServersNegativeTestJSON-1096159787 None] Lock "cinder-3c455bbe-7192-4666-bb44-791a4a5899b8-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Flow 'volume_create_manager' (e2bbc8ab-fe5b-46fb-b5e7-263895d15641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9e29d6-9100-4ada-8a29-5f7cff88cca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9e29d6-9100-4ada-8a29-5f7cff88cca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1438867616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954a9c81-f4f1-4254-92c6-c07b94cc3e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edc6f6f2bdc4a1aadcb6c1fbe9d618f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:58Z,use_quota=True,user_id='7867b5dc1b9d43188e790a6638de4c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce046aa-a5d5-44d8-b6d5-8358ce53bbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce046aa-a5d5-44d8-b6d5-8358ce53bbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38f13cb-67a2-4678-9c48-81d1bbc538c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38f13cb-67a2-4678-9c48-81d1bbc538c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954a9c81-f4f1-4254-92c6-c07b94cc3e3a', 'volume_name': 'volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d29ba6-b85e-4f7b-b7f5-152507aefc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d29ba6-b85e-4f7b-b7f5-152507aefc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee28508b-1a8c-4670-935b-2d44ea396506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:51:57 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Volume 954a9c81-f4f1-4254-92c6-c07b94cc3e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a', 'volume_size': 1} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1438867616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954a9c81-f4f1-4254-92c6-c07b94cc3e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edc6f6f2bdc4a1aadcb6c1fbe9d618f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:51:58Z,use_quota=True,user_id='7867b5dc1b9d43188e790a6638de4c54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Creating volume 954a9c81-f4f1-4254-92c6-c07b94cc3e3a {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:51:57 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:51:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:58 devstack sudo[84142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a 1073741824 Apr 21 20:51:58 devstack sudo[84142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:51:59 devstack sudo[84142]: pam_unix(sudo:session): session closed for user root Apr 21 20:51:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a 1073741824" returned: 0 in 1.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:51:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:51:59 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a Apr 21 20:51:59 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:00 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" returned: 0 in 1.050s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] <== create_volume: return (2578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.581s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee28508b-1a8c-4670-935b-2d44ea396506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f481d2a2-4441-4e12-a717-fb21b6d6bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:00 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Volume volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a (954a9c81-f4f1-4254-92c6-c07b94cc3e3a): created successfully Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f481d2a2-4441-4e12-a717-fb21b6d6bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Flow 'volume_create_manager' (e2bbc8ab-fe5b-46fb-b5e7-263895d15641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:00 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-29a37160-7336-47d0-87e8-463df826f3b0 tempest-DeleteServersTestJSON-1481880648 None] Created volume successfully. Apr 21 20:52:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:04 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4084122-77e4-4734-9d7e-df5c2da7f134]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:04 devstack sudo[84213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a Apr 21 20:52:04 devstack sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:06 devstack sudo[84213]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" returned: 0 in 1.322s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.399s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc', 'name': 'volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14fa58c6-0499-4ff2-bf61-3ae042f472e0', 'enforce_multipath': True} {{(pid=81991) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:52:06 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-af94540b-2f38-4660-bb82-c051f1ee5b32 req-26388b7a-a414-4f33-8d4f-5d96846a83e8 tempest-DeleteServersTestJSON-1481880648 None] attachment_update completed successfully. Apr 21 20:52:06 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Flow 'volume_create_manager' (c599129e-4b7f-4186-aeeb-813a683c6d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb2fbca-fe90-4c31-a73e-a83e60c53a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb2fbca-fe90-4c31-a73e-a83e60c53a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1116827486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b75033eb7634f92b84b4e56bc0ef490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:07Z,use_quota=True,user_id='b8023663441a4ef18643fbe9bf084dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa50891-07ea-4240-be41-c5ee18105a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa50891-07ea-4240-be41-c5ee18105a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c230538a-d338-4317-ba9d-f8b92ebfe0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c230538a-d338-4317-ba9d-f8b92ebfe0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975', 'volume_name': 'volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a2a5d8-f921-4c85-9211-a2f28bbd5b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a2a5d8-f921-4c85-9211-a2f28bbd5b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b5185b-6ea3-4116-a075-ed3a7cc4640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Volume dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975', 'volume_size': 1} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1116827486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b75033eb7634f92b84b4e56bc0ef490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:07Z,use_quota=True,user_id='b8023663441a4ef18643fbe9bf084dba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Creating volume dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:07 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:07 devstack sudo[84227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 1073741824 Apr 21 20:52:07 devstack sudo[84227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:07 devstack sudo[84227]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 1073741824" returned: 0 in 0.895s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:08 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 Apr 21 20:52:08 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:08 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975" returned: 0 in 0.530s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61b5185b-6ea3-4116-a075-ed3a7cc4640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbf7a5e-f823-49a8-bd09-e71c15bfca1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:08 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Volume volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 (dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975): created successfully Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbf7a5e-f823-49a8-bd09-e71c15bfca1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Flow 'volume_create_manager' (c599129e-4b7f-4186-aeeb-813a683c6d03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:08 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ad56a6e3-c7e3-461f-8a09-b2e5c01e2487 tempest-VolumesServicesTestJSON-1380515033 None] Created volume successfully. Apr 21 20:52:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Acquiring lock "cinder-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Lock "cinder-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Acquiring lock "cinder-quobyte-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Lock "cinder-quobyte-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975" acquired by "delete_volume" :: waited 0.024s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:09 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fac6e8-9397-446e-a62a-45bc72565f1b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:09 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 Apr 21 20:52:09 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:10 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975" returned: 0 in 0.928s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:10 devstack sudo[84249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975 Apr 21 20:52:10 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:11 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975" returned: 0 in 0.958s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Lock "cinder-quobyte-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975" released by "delete_volume" :: held 1.963s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Created reservations ['146b58ff-6490-4498-866b-883aee9c1aa8', '3729a32c-8d6a-45ed-9a65-1bc517815bdb', '3188f0d4-3daf-4970-8792-823ef616be84', '9e5410eb-a522-4708-bc92-8d165c9388ac'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:11 devstack sudo[84289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:11 devstack sudo[84289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Flow 'volume_create_manager' (e202fa36-58f0-427d-966f-1f6a1494814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d347f40-144c-49a6-b05a-fffb5f7d6407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d347f40-144c-49a6-b05a-fffb5f7d6407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-726268145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597d970e-f119-4dfa-90a3-0fcc8d924217,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5322ce86c5dd4e5b9be32690f58bd6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:12Z,use_quota=True,user_id='f0c996faa64847959abdcc82a434a84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bf31dd-6b75-454a-97a6-d2020a12f7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bf31dd-6b75-454a-97a6-d2020a12f7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a18ff9-cd2e-46ab-90fc-bc13157b67ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a18ff9-cd2e-46ab-90fc-bc13157b67ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597d970e-f119-4dfa-90a3-0fcc8d924217', 'volume_name': 'volume-597d970e-f119-4dfa-90a3-0fcc8d924217', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88fd558-481d-4086-b5c0-a92539887b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88fd558-481d-4086-b5c0-a92539887b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c45efd-c81b-4cdb-839b-30af7f1ce553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:12 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Volume 597d970e-f119-4dfa-90a3-0fcc8d924217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597d970e-f119-4dfa-90a3-0fcc8d924217', 'volume_size': 1} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-726268145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597d970e-f119-4dfa-90a3-0fcc8d924217,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5322ce86c5dd4e5b9be32690f58bd6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:12Z,use_quota=True,user_id='f0c996faa64847959abdcc82a434a84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Creating volume 597d970e-f119-4dfa-90a3-0fcc8d924217 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:12 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:12 devstack sudo[84291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 1073741824 Apr 21 20:52:12 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:12 devstack sudo[84289]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.741s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Deleted volume successfully. Apr 21 20:52:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c4e39b97-35ad-40c7-9878-d5b9838f7076 tempest-VolumesServicesTestJSON-1380515033 None] Lock "cinder-dc1f0a6f-46e0-4344-85f9-d3b9fc0f5975-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:13 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 1073741824" returned: 0 in 1.007s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:13 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 Apr 21 20:52:13 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:13 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217" returned: 0 in 0.637s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c45efd-c81b-4cdb-839b-30af7f1ce553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597d970e-f119-4dfa-90a3-0fcc8d924217', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7a0eb0-f804-4746-b007-5aba75016afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:13 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Volume volume-597d970e-f119-4dfa-90a3-0fcc8d924217 (597d970e-f119-4dfa-90a3-0fcc8d924217): created successfully Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7a0eb0-f804-4746-b007-5aba75016afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Flow 'volume_create_manager' (e202fa36-58f0-427d-966f-1f6a1494814f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:13 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-554e8018-7afd-4d0c-b813-220eb95cd86a tempest-VolumesTestJSON-1626998923 None] Created volume successfully. Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Flow 'volume_create_manager' (6258099d-632d-4d7e-a7de-aba86619bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdd8a13-4421-4c9d-8851-86987b18dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdd8a13-4421-4c9d-8851-86987b18dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1492913292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5642647-5a42-49c3-8fbf-148499ddbe9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5322ce86c5dd4e5b9be32690f58bd6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:15Z,use_quota=True,user_id='f0c996faa64847959abdcc82a434a84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a58e34c-5821-45ab-a264-fe33c12476c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a58e34c-5821-45ab-a264-fe33c12476c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2a83f6-1a3a-4b78-94e3-4f88873ccfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2a83f6-1a3a-4b78-94e3-4f88873ccfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5642647-5a42-49c3-8fbf-148499ddbe9a', 'volume_name': 'volume-c5642647-5a42-49c3-8fbf-148499ddbe9a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cfdc6b-d6f7-47b8-83bf-acc57583d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cfdc6b-d6f7-47b8-83bf-acc57583d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cd767f-672a-48f8-bf6c-526b1dd9dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:14 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Volume c5642647-5a42-49c3-8fbf-148499ddbe9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5642647-5a42-49c3-8fbf-148499ddbe9a', 'volume_size': 1} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1492913292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5642647-5a42-49c3-8fbf-148499ddbe9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5322ce86c5dd4e5b9be32690f58bd6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:15Z,use_quota=True,user_id='f0c996faa64847959abdcc82a434a84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Creating volume c5642647-5a42-49c3-8fbf-148499ddbe9a {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:14 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:14 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a 1073741824 Apr 21 20:52:14 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:15 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a 1073741824" returned: 0 in 0.658s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:15 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a Apr 21 20:52:15 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-e16ed0cd-13d4-4746-9e7d-29e14cfe31c5 req-0f4bbc0c-0ce5-4107-9db9-43c7f66d1afa tempest-DeleteServersTestJSON-1481880648 None] Terminate volume connection completed successfully. Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-e16ed0cd-13d4-4746-9e7d-29e14cfe31c5 req-0f4bbc0c-0ce5-4107-9db9-43c7f66d1afa tempest-DeleteServersTestJSON-1481880648 None] Deleting attachment 14fa58c6-0499-4ff2-bf61-3ae042f472e0. {{(pid=81991) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:52:15 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1cd767f-672a-48f8-bf6c-526b1dd9dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5642647-5a42-49c3-8fbf-148499ddbe9a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ec6e72-4d56-44cd-b4f2-c1e768ea94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Volume volume-c5642647-5a42-49c3-8fbf-148499ddbe9a (c5642647-5a42-49c3-8fbf-148499ddbe9a): created successfully Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ec6e72-4d56-44cd-b4f2-c1e768ea94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Flow 'volume_create_manager' (6258099d-632d-4d7e-a7de-aba86619bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a2fdaa6c-3752-4f2d-9420-a089523d306c tempest-VolumesTestJSON-1626998923 None] Created volume successfully. Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Flow 'volume_create_manager' (a5d361c6-8e31-464b-8064-c0f59e381093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71eab2d-4db7-4e36-b019-8adc82c47b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71eab2d-4db7-4e36-b019-8adc82c47b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-801293582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10264b93-6c0b-4729-acdb-d294ce4dddb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5322ce86c5dd4e5b9be32690f58bd6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:17Z,use_quota=True,user_id='f0c996faa64847959abdcc82a434a84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f04395e-e8e2-4bea-879f-dead2f15c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f04395e-e8e2-4bea-879f-dead2f15c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45b12a8-7170-4b6f-a20c-b274d34b7935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45b12a8-7170-4b6f-a20c-b274d34b7935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10264b93-6c0b-4729-acdb-d294ce4dddb5', 'volume_name': 'volume-10264b93-6c0b-4729-acdb-d294ce4dddb5', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0647b5-9fe3-4917-9388-99f645426c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0647b5-9fe3-4917-9388-99f645426c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910c4787-9187-4c6a-8165-2403fac3739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:17 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Volume 10264b93-6c0b-4729-acdb-d294ce4dddb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10264b93-6c0b-4729-acdb-d294ce4dddb5', 'volume_size': 1} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-801293582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10264b93-6c0b-4729-acdb-d294ce4dddb5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5322ce86c5dd4e5b9be32690f58bd6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:17Z,use_quota=True,user_id='f0c996faa64847959abdcc82a434a84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Creating volume 10264b93-6c0b-4729-acdb-d294ce4dddb5 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:17 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:17 devstack sudo[84342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 1073741824 Apr 21 20:52:17 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:18 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 1073741824" returned: 0 in 0.947s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:18 devstack sudo[84348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 Apr 21 20:52:18 devstack sudo[84348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Flow 'volume_create_manager' (10abc412-418a-4e49-ae62-1f6c5aa82d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7f94f3-96cd-4e46-943c-9ba7a3380a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7f94f3-96cd-4e46-943c-9ba7a3380a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9311a94-08db-41a1-83e9-986489cca95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a16c1e42a14cbdbeb48b46bf4456bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:18Z,use_quota=True,user_id='b5568b8d85d04d149620893db3747a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9adda4-769d-4195-8aeb-419ea30e4a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9adda4-769d-4195-8aeb-419ea30e4a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7789699f-263a-445d-87d4-ec8108704f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:18 devstack cinder-volume[81991]: DEBUG cinder.image.glance [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Creating Keystone auth plugin from conf {{(pid=81991) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7789699f-263a-445d-87d4-ec8108704f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9311a94-08db-41a1-83e9-986489cca95f', 'volume_name': 'volume-f9311a94-08db-41a1-83e9-986489cca95f', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ad9ca6-7251-46c3-a5bf-b99b6e5d1510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ad9ca6-7251-46c3-a5bf-b99b6e5d1510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa2496b-dfa6-4b48-a4ad-f6a652b3e212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:19 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Volume f9311a94-08db-41a1-83e9-986489cca95f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9311a94-08db-41a1-83e9-986489cca95f', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Trying to clone f9311a94-08db-41a1-83e9-986489cca95f from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]). {{(pid=81991) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:52:19 devstack sudo[84348]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:52:19 devstack cinder-volume[81991]: INFO cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5" returned: 0 in 0.894s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (910c4787-9187-4c6a-8165-2403fac3739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10264b93-6c0b-4729-acdb-d294ce4dddb5', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f8f5ab-1314-4dc2-8fce-7755908cd5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbecf2b-d7c3-4bf7-afde-0df5773f5f1e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:19 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Volume volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 (10264b93-6c0b-4729-acdb-d294ce4dddb5): created successfully Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f8f5ab-1314-4dc2-8fce-7755908cd5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Flow 'volume_create_manager' (a5d361c6-8e31-464b-8064-c0f59e381093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Acquiring lock "cinder-954a9c81-f4f1-4254-92c6-c07b94cc3e3a-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:19 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ae7b2619-133d-4600-9e4c-836cf91e3171 tempest-VolumesTestJSON-1626998923 None] Created volume successfully. Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Lock "cinder-954a9c81-f4f1-4254-92c6-c07b94cc3e3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Acquiring lock "cinder-quobyte-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Lock "cinder-quobyte-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[570e372c-45e3-4595-a31e-4fd2e405cc1b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:19 devstack sudo[84373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a Apr 21 20:52:19 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:19 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD Apr 21 20:52:19 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:20 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD" returned: 0 in 1.119s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:20 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 is fetched for user b5568b8d85d04d149620893db3747a0f. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:52:20 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" returned: 0 in 1.024s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:20 devstack sudo[84383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a Apr 21 20:52:20 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:20 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8de980-4607-4713-b2e6-c8989f4820af]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:20 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD Apr 21 20:52:20 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "cinder-10264b93-6c0b-4729-acdb-d294ce4dddb5-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-10264b93-6c0b-4729-acdb-d294ce4dddb5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "cinder-quobyte-10264b93-6c0b-4729-acdb-d294ce4dddb5" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-quobyte-10264b93-6c0b-4729-acdb-d294ce4dddb5" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5eb3a9-587a-4c7a-818d-5c416416368d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack sudo[84388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 Apr 21 20:52:21 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:21 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" returned: 0 in 0.774s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Lock "cinder-quobyte-954a9c81-f4f1-4254-92c6-c07b94cc3e3a" released by "delete_volume" :: held 1.829s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Created reservations ['6dbab8c1-f83a-4e1a-9f08-e47b22ec813c', '6c312547-921f-47ba-b176-806f89303fbf', 'f9f05031-12f5-4113-9eab-183b6c01676a', '8d4f9d89-87a0-46be-bd0b-90d6a8216390'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:21 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9311a94-08db-41a1-83e9-986489cca95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6a16c1e42a14cbdbeb48b46bf4456bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:18Z,use_quota=True,user_id='b5568b8d85d04d149620893db3747a0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Creating volume f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:21 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack sudo[84401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f 1073741824 Apr 21 20:52:21 devstack sudo[84401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:21 devstack sudo[84403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:21 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5" returned: 0 in 1.184s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[84426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5 Apr 21 20:52:22 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:22 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack sudo[84401]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.883s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f 1073741824" returned: 0 in 0.966s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Deleted volume successfully. Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6b42d14c-8fc7-4458-a847-705db9d8ed08 tempest-DeleteServersTestJSON-1481880648 None] Lock "cinder-954a9c81-f4f1-4254-92c6-c07b94cc3e3a-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:22 devstack sudo[84428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:52:22 devstack sudo[84428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-10264b93-6c0b-4729-acdb-d294ce4dddb5" returned: 0 in 0.702s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-quobyte-10264b93-6c0b-4729-acdb-d294ce4dddb5" released by "delete_volume" :: held 1.927s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Flow 'volume_create_manager' (c70a12c5-0714-4e98-a30d-9888b7b52cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2159eb8c-8120-433a-ae98-dd7cbeab53ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2159eb8c-8120-433a-ae98-dd7cbeab53ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-471340683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c783d0-94d5-4543-bc2d-f773a20c0d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4f6b59b064773b615b81f6c721ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:23Z,use_quota=True,user_id='23f2a28e25dc44859f6fa46e033adce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64a376f-ae4d-40a8-8eff-e0203dfd0ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64a376f-ae4d-40a8-8eff-e0203dfd0ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89382d0a-dba4-4c27-89af-6091764c8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89382d0a-dba4-4c27-89af-6091764c8663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c783d0-94d5-4543-bc2d-f773a20c0d47', 'volume_name': 'volume-05c783d0-94d5-4543-bc2d-f773a20c0d47', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1609d33-936d-4e07-9c4d-c37032b7d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1609d33-936d-4e07-9c4d-c37032b7d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf377c38-2c84-4a6b-91a9-8ef02ee5e8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:23 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Volume 05c783d0-94d5-4543-bc2d-f773a20c0d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c783d0-94d5-4543-bc2d-f773a20c0d47', 'volume_size': 1} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Created reservations ['5acdcf46-10c2-4a46-9d19-4793799ad111', '27c44d31-6bad-4c40-a2f7-d5f09e83e774', '91d9ca19-cd5c-4ffa-8493-50f79b66a567', 'a9ebbccc-da4e-4249-99b4-c876ac3ba0f3'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:23 devstack sudo[84428]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 0 in 0.728s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-471340683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c783d0-94d5-4543-bc2d-f773a20c0d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4f6b59b064773b615b81f6c721ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:23Z,use_quota=True,user_id='23f2a28e25dc44859f6fa46e033adce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Creating volume 05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:23 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack sudo[84440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 1073741824 Apr 21 20:52:23 devstack sudo[84440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Attempting download of 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume f9311a94-08db-41a1-83e9-986489cca95f. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ffcc1-6261-4b11-ab64-452f64254d71]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:23 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:23 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:23 devstack sudo[84443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3 Apr 21 20:52:23 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:24 devstack sudo[84440]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 1073741824" returned: 0 in 0.770s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:24 devstack sudo[84452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:24 devstack sudo[84452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:24 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3" returned: 0 in 0.782s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:24 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.870s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:24 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Deleted volume successfully. Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-62e59afd-d86f-4e1d-a830-608235a71371 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-10264b93-6c0b-4729-acdb-d294ce4dddb5-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:24 devstack sudo[84455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3 Apr 21 20:52:24 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Acquiring lock "cinder-c5642647-5a42-49c3-8fbf-148499ddbe9a-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Lock "cinder-c5642647-5a42-49c3-8fbf-148499ddbe9a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Acquiring lock "cinder-quobyte-c5642647-5a42-49c3-8fbf-148499ddbe9a" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Lock "cinder-quobyte-c5642647-5a42-49c3-8fbf-148499ddbe9a" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[35983271-ca08-4387-8906-04142cc69319]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:24 devstack sudo[84457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a Apr 21 20:52:24 devstack sudo[84457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:24 devstack sudo[84452]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 0.744s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf377c38-2c84-4a6b-91a9-8ef02ee5e8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c783d0-94d5-4543-bc2d-f773a20c0d47', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e6e353-cfe4-4bdc-ade5-d057d6d53c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:24 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Volume volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 (05c783d0-94d5-4543-bc2d-f773a20c0d47): created successfully Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e6e353-cfe4-4bdc-ade5-d057d6d53c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Flow 'volume_create_manager' (c70a12c5-0714-4e98-a30d-9888b7b52cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:24 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e3abcc48-de9f-487e-a7d6-0ff49bd08b55 tempest-VolumesDeleteCascade-1580693855 None] Created volume successfully. Apr 21 20:52:25 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3" returned: 1 in 0.937s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_br0lhfb3' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e3820-3f90-4cde-aa9e-64f28b46b2f3]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:25 devstack sudo[84462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD Apr 21 20:52:25 devstack sudo[84462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:25 devstack sudo[84457]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a" returned: 0 in 0.821s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:25 devstack sudo[84467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a Apr 21 20:52:25 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Creating offline snapshot 4fe414d4-b5d2-4a78-8d05-9585d8186d11 of volume 05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad5ec6-b90e-445d-996b-2fddcf8b7753]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:25 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:25 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:25 devstack sudo[84462]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 was qcow2, converting to raw {{(pid=81991) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:26 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c5642647-5a42-49c3-8fbf-148499ddbe9a" returned: 0 in 0.680s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Lock "cinder-quobyte-c5642647-5a42-49c3-8fbf-148499ddbe9a" released by "delete_volume" :: held 1.536s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:26 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:52:26 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Created reservations ['17ec165d-dcec-4d32-a938-be527abb3672', 'a5b4cc8a-18c1-4f12-9a93-1edb6747df0e', '97553fa2-36a4-49d9-aeb9-2d7436527f61', '4cc30e7b-c242-4238-a6dc-d03a7e44f82c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:26 devstack sudo[84479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:26 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:26 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 1.027s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:26 devstack sudo[84487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 1G Apr 21 20:52:26 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "cinder-597d970e-f119-4dfa-90a3-0fcc8d924217-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-597d970e-f119-4dfa-90a3-0fcc8d924217-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "cinder-quobyte-597d970e-f119-4dfa-90a3-0fcc8d924217" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-quobyte-597d970e-f119-4dfa-90a3-0fcc8d924217" acquired by "delete_volume" :: waited 0.023s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dcfd9f-1690-4e23-899f-25df90a09c7a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:26 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.767s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:26 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Deleted volume successfully. Apr 21 20:52:27 devstack sudo[84491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 Apr 21 20:52:27 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-635d1aed-9e26-463e-a243-ac6d3cff21ad tempest-VolumesTestJSON-1626998923 None] Lock "cinder-c5642647-5a42-49c3-8fbf-148499ddbe9a-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:27 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 0 in 1.256s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_fhmlt9rpdevstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:52:27 devstack cinder-volume[81991]: INFO cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Converted 112.00 MB image at 89.02 MB/s Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:27 devstack sudo[84497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f 1G Apr 21 20:52:27 devstack sudo[84497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:27 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 1G" returned: 0 in 0.873s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:27 devstack sudo[84499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:27 devstack sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:27 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217" returned: 0 in 0.938s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:27 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217 Apr 21 20:52:27 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:27 devstack sudo[84499]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.603s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:27 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 is being set with open permissions: ugo+rw Apr 21 20:52:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack sudo[84512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:28 devstack sudo[84512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:28 devstack sudo[84497]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f 1G" returned: 0 in 0.877s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b8294b-779e-4dfc-b74e-ed66ad7d066d]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:52:28 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:28 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-597d970e-f119-4dfa-90a3-0fcc8d924217" returned: 0 in 0.545s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-quobyte-597d970e-f119-4dfa-90a3-0fcc8d924217" released by "delete_volume" :: held 1.512s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Created reservations ['bcaecec1-e81c-4c2d-915c-9af628679214', '013f9ec5-eb65-495a-a669-29a32f70b181', '7beeb14e-2f49-477d-b898-4d21a5226ac6', 'f44741cb-78a8-4690-9b18-00ef9f9d7a3a'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack sudo[84518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:28 devstack sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:28 devstack sudo[84512]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.668s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:28 devstack sudo[84520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info Apr 21 20:52:28 devstack sudo[84520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:28 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 0 in 0.755s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:29 devstack sudo[84524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:52:29 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:29 devstack sudo[84518]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.757s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:29 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Deleted volume successfully. Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36df2d7b-779e-4c57-a8f0-1d6c8de34430 tempest-VolumesTestJSON-1626998923 None] Lock "cinder-597d970e-f119-4dfa-90a3-0fcc8d924217-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Flow 'volume_create_manager' (27e4d64e-31bc-4de5-b630-0775c84d969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a8f550-643c-4026-8189-a04b2b1ec0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a8f550-643c-4026-8189-a04b2b1ec0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-139822434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27caba2a-3031-4bb1-b20f-5d8f27ec0fba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edbbe573626149178451a179543a5f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:29Z,use_quota=True,user_id='45e4f3c584864c3c9895b41fbfbce971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afb3a36-946d-4c49-867a-43d964f17103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afb3a36-946d-4c49-867a-43d964f17103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e637b0b-95e7-4cae-ace3-c7e33cc8eeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e637b0b-95e7-4cae-ace3-c7e33cc8eeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27caba2a-3031-4bb1-b20f-5d8f27ec0fba', 'volume_name': 'volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2944ed67-a740-4b1e-afcd-398819320f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2944ed67-a740-4b1e-afcd-398819320f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83198340-08da-4c62-b780-f8d260fba0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:29 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Volume 27caba2a-3031-4bb1-b20f-5d8f27ec0fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba', 'volume_size': 1} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:29 devstack sudo[84520]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info" returned: 0 in 0.922s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:29 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info is being set with open permissions: ugo+rw Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:29 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info Apr 21 20:52:29 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:29 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 1 in 0.776s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Downloaded image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume f9311a94-08db-41a1-83e9-986489cca95f successfully. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 for user b5568b8d85d04d149620893db3747a0f is deleted. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Marking volume f9311a94-08db-41a1-83e9-986489cca95f as bootable. {{(pid=81991) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Copying metadata from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 to f9311a94-08db-41a1-83e9-986489cca95f. {{(pid=81991) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Creating volume glance metadata for volume f9311a94-08db-41a1-83e9-986489cca95f backed by image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81991) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa2496b-dfa6-4b48-a4ad-f6a652b3e212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9311a94-08db-41a1-83e9-986489cca95f', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb64819d-9933-480d-a39f-9e6bfd91c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:29 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Volume volume-f9311a94-08db-41a1-83e9-986489cca95f (f9311a94-08db-41a1-83e9-986489cca95f): created successfully Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb64819d-9933-480d-a39f-9e6bfd91c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Flow 'volume_create_manager' (10abc412-418a-4e49-ae62-1f6c5aa82d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:29 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-7b6fae01-8743-43f2-96b8-d7b3ab99f9d8 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Created volume successfully. Apr 21 20:52:30 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.info" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.691s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-139822434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27caba2a-3031-4bb1-b20f-5d8f27ec0fba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edbbe573626149178451a179543a5f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:29Z,use_quota=True,user_id='45e4f3c584864c3c9895b41fbfbce971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Creating volume 27caba2a-3031-4bb1-b20f-5d8f27ec0fba {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:30 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:30 devstack sudo[84534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba 1073741824 Apr 21 20:52:30 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:30 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c319d7b5-afdf-4539-8a1c-74c7d15265c3 tempest-VolumesDeleteCascade-1580693855 None] Create snapshot completed successfully Apr 21 20:52:30 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba 1073741824" returned: 0 in 0.535s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:30 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba Apr 21 20:52:30 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:31 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba" returned: 0 in 0.497s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.359s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83198340-08da-4c62-b780-f8d260fba0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13857fc-82b9-4f05-88e2-6fba252182d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Creating offline snapshot d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee of volume 05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:31 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Volume volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba (27caba2a-3031-4bb1-b20f-5d8f27ec0fba): created successfully Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13857fc-82b9-4f05-88e2-6fba252182d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Flow 'volume_create_manager' (27e4d64e-31bc-4de5-b630-0775c84d969d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897eef6-80eb-4038-bfb2-ee142c39e9e6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-bca47435-0857-467e-b6ca-06cc3e7ee641 req-473bd969-d3ce-4b2b-a480-2e184bc40f4d tempest-VolumesGetTestJSON-1581040704 None] Created volume successfully. Apr 21 20:52:31 devstack sudo[84550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:31 devstack sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:31 devstack sudo[84550]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.545s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c783d0-94d5-4543-bc2d-f773a20c0d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:31 devstack sudo[84555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee 1G Apr 21 20:52:31 devstack sudo[84555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:32 devstack sudo[84555]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee 1G" returned: 0 in 0.458s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:32 devstack sudo[84560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee Apr 21 20:52:32 devstack sudo[84560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:32 devstack sudo[84560]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" returned: 0 in 0.454s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:32 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee is being set with open permissions: ugo+rw Apr 21 20:52:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:32 devstack sudo[84565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee Apr 21 20:52:32 devstack sudo[84565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Acquiring lock "cinder-27caba2a-3031-4bb1-b20f-5d8f27ec0fba-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Lock "cinder-27caba2a-3031-4bb1-b20f-5d8f27ec0fba-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c3f81a6f-a85c-4efb-86b3-83dd9f2559f7 tempest-BackendsCapabilitiesAdminTestsJSON-178956705 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81991) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Acquiring lock "cinder-quobyte-27caba2a-3031-4bb1-b20f-5d8f27ec0fba" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Lock "cinder-quobyte-27caba2a-3031-4bb1-b20f-5d8f27ec0fba" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a01540-cc74-475b-ae8f-abe66e98ee60]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack sudo[84567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba Apr 21 20:52:33 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:33 devstack sudo[84565]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" returned: 0 in 0.462s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.019s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb5278c-d2bf-4545-bea6-120784f4959e]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1a5dccd8-20e2-4b92-81f5-fe0eabe3e868 tempest-VolumesDeleteCascade-1580693855 None] Create snapshot completed successfully Apr 21 20:52:33 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:52:33 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:33 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba" returned: 0 in 0.547s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3a7f03db-3737-4a0d-b0f2-b4012c0ea19b tempest-BackendsCapabilitiesAdminTestsJSON-178956705 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327842712402, 'free_capacity_gb': 1775.7327842712402, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81991) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 21 20:52:33 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba Apr 21 20:52:33 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:33 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 0 in 0.540s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:33 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:52:33 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:34 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-27caba2a-3031-4bb1-b20f-5d8f27ec0fba" returned: 0 in 0.437s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Lock "cinder-quobyte-27caba2a-3031-4bb1-b20f-5d8f27ec0fba" released by "delete_volume" :: held 1.007s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.quota [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Created reservations ['ab1c73b6-27d8-4271-852c-a25196cfd428', '8e0da64a-0775-4553-a141-ed0cfbc6fef5', '3affa6dd-b91b-4169-9517-27ee1b396eb0', '0e75b071-84a8-4394-8658-914d06c201a6'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:34 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:34 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-05c783d0-94d5-4543-bc2d-f773a20c0d47-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-05c783d0-94d5-4543-bc2d-f773a20c0d47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Performing cascade delete. {{(pid=81991) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-4fe414d4-b5d2-4a78-8d05-9585d8186d11-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-4fe414d4-b5d2-4a78-8d05-9585d8186d11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-4fe414d4-b5d2-4a78-8d05-9585d8186d11" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-4fe414d4-b5d2-4a78-8d05-9585d8186d11" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Deleting offline snapshot 4fe414d4-b5d2-4a78-8d05-9585d8186d11 of volume 05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] snapshot_file for this snap is: volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc0412f-0341-4d11-9313-3d9375f74de6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:34 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 1 in 0.575s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.150s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc', 'name': 'volume-f9311a94-08db-41a1-83e9-986489cca95f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd457d87b-d80b-47ff-a162-3374b4765644', 'enforce_multipath': True} {{(pid=81991) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 21 20:52:34 devstack sudo[84587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:34 devstack sudo[84587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:34 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-6a0cecac-882f-4ff9-8210-6d4a049af36d req-507866ba-11fd-4174-9f42-76fa92d45aa6 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] attachment_update completed successfully. Apr 21 20:52:34 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.571s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.manager [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:34 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Deleted volume successfully. Apr 21 20:52:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-87f2cda4-634a-44d3-b39a-db436820cf47 req-837abb6c-5c91-486a-a609-869e53bbdb09 tempest-VolumesGetTestJSON-1581040704 None] Lock "cinder-27caba2a-3031-4bb1-b20f-5d8f27ec0fba-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:35 devstack sudo[84587]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.728s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c783d0-94d5-4543-bc2d-f773a20c0d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8900cd-5688-47f0-9780-1fe3718e138c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:35 devstack sudo[84593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:35 devstack sudo[84593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:35 devstack sudo[84593]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 0.629s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a84d9a3-b9e5-4c2e-b8fb-52dd436d8805]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:35 devstack sudo[84598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee Apr 21 20:52:35 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:36 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" returned: 0 in 0.733s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c783d0-94d5-4543-bc2d-f773a20c0d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca15cabf-8a4e-47dc-a691-b17f3e25f8a6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:36 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:36 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:36 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.530s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c783d0-94d5-4543-bc2d-f773a20c0d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22fcc1-e82f-4d44-85f1-4bf841da84ae]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:37 devstack sudo[84609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:37 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:37 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 0.636s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:37 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:37 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b7167d0e-ec5d-4da4-995c-6cfec06e84de tempest-GroupsV314Test-687415325 None] Group tempest-GroupsV314Test-Group-1485568513: creating Apr 21 20:52:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b7167d0e-ec5d-4da4-995c-6cfec06e84de tempest-GroupsV314Test-687415325 None] Group tempest-GroupsV314Test-Group-1485568513: created successfully Apr 21 20:52:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b7167d0e-ec5d-4da4-995c-6cfec06e84de tempest-GroupsV314Test-687415325 None] Create group completed successfully. Apr 21 20:52:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b2561401-787d-4951-a8b7-64f4f0b896c4 tempest-GroupSnapshotsTest-1231936981 None] Group tempest-GroupSnapshotsTest-Group-1858493200: creating Apr 21 20:52:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b2561401-787d-4951-a8b7-64f4f0b896c4 tempest-GroupSnapshotsTest-1231936981 None] Group tempest-GroupSnapshotsTest-Group-1858493200: created successfully Apr 21 20:52:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b2561401-787d-4951-a8b7-64f4f0b896c4 tempest-GroupSnapshotsTest-1231936981 None] Create group completed successfully. Apr 21 20:52:38 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.543s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:38 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11 Apr 21 20:52:38 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:38 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.4fe414d4-b5d2-4a78-8d05-9585d8186d11" returned: 0 in 0.445s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee -F qcow2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:38 devstack sudo[84625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee -F qcow2 Apr 21 20:52:38 devstack sudo[84625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:39 devstack sudo[84625]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee -F qcow2" returned: 0 in 0.751s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-4fe414d4-b5d2-4a78-8d05-9585d8186d11" released by "_delete_snapshot" :: held 5.107s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" released by "delete_snapshot" :: held 5.124s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Created reservations ['ef860240-8d85-424f-ae03-3b623e4ba719', '7ff24d12-d360-4410-aa65-dc058646b20f', '75f73347-8566-425e-8ec3-90259eb30809', 'cc26ba0b-5220-47af-9f73-ec596ad64542'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Flow 'volume_create_manager' (cdef99cf-dc2c-4208-ad73-366360625d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195b5d16-f795-4a1a-a8a3-8a46e9deb116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195b5d16-f795-4a1a-a8a3-8a46e9deb116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853046770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a293dc94-2186-4ece-8b7f-bea4a80fb9d4,host='devstack@QuobyteHD#QuobyteHD',id=fe4514b4-d6c0-4417-a0a6-2e9afb078aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78add46255ae4feb829e88d1c805032b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:40Z,use_quota=True,user_id='fe0ece98cc8444b1b473f507db073e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2f9f307-d01e-4426-96bd-7f66a4cc126a),volume_type_id=b2f9f307-d01e-4426-96bd-7f66a4cc126a)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170fd5e1-d6f9-4b68-bbe7-68e59a87ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (170fd5e1-d6f9-4b68-bbe7-68e59a87ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc94ae54-a991-4aab-8edc-c5a08e4b5c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc94ae54-a991-4aab-8edc-c5a08e4b5c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4514b4-d6c0-4417-a0a6-2e9afb078aa1', 'volume_name': 'volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3889f4de-b0e3-4afe-9903-0ff9ae84b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3889f4de-b0e3-4afe-9903-0ff9ae84b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ec27f6-6f2a-4911-945a-0588d3a13f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Volume fe4514b4-d6c0-4417-a0a6-2e9afb078aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1', 'volume_size': 1} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a293dc94-2186-4ece-8b7f-bea4a80fb9d4,created_at=2026-04-21T18:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-853046770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a293dc94-2186-4ece-8b7f-bea4a80fb9d4,host='devstack@QuobyteHD#QuobyteHD',id=fe4514b4-d6c0-4417-a0a6-2e9afb078aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78add46255ae4feb829e88d1c805032b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:40Z,use_quota=True,user_id='fe0ece98cc8444b1b473f507db073e2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2f9f307-d01e-4426-96bd-7f66a4cc126a),volume_type_id=b2f9f307-d01e-4426-96bd-7f66a4cc126a)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Creating volume fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:39 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:39 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Delete snapshot completed successfully. Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-4fe414d4-b5d2-4a78-8d05-9585d8186d11-delete_snapshot" released by "delete_snapshot" :: held 5.467s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:39 devstack sudo[84660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 1073741824 Apr 21 20:52:39 devstack sudo[84660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (a20d928c-5860-4395-b32a-7f0655b34c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900c94c2-afde-4fb4-80f8-97e314b702ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900c94c2-afde-4fb4-80f8-97e314b702ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155072311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dd712f9-8c36-42c4-aee4-a382693ceb70,host='devstack@QuobyteHD#QuobyteHD',id=e5c698d7-6e67-40a2-8c64-96a8f36b2cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:40Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e60070ac-594c-4629-ba86-54b0571eed17),volume_type_id=e60070ac-594c-4629-ba86-54b0571eed17)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75978dac-58e4-469e-9e4c-afd3ad3002af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75978dac-58e4-469e-9e4c-afd3ad3002af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24dbb46-33d8-43f1-a792-842fb687d40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24dbb46-33d8-43f1-a792-842fb687d40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c698d7-6e67-40a2-8c64-96a8f36b2cae', 'volume_name': 'volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b4e15a-a9ce-4460-9c85-def37f0be59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b4e15a-a9ce-4460-9c85-def37f0be59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9558c0-fc66-4ba8-8944-5c398b9677b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:39 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Volume e5c698d7-6e67-40a2-8c64-96a8f36b2cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae', 'volume_size': 1} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Deleting offline snapshot d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee of volume 05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] snapshot_file for this snap is: volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c04363-4506-4e23-9ea0-5e815d390d73]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:39 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee Apr 21 20:52:39 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:40 devstack sudo[84660]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 1073741824" returned: 0 in 0.708s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:40 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:40 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:40 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" returned: 0 in 0.635s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05c783d0-94d5-4543-bc2d-f773a20c0d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[41566086-dbf2-47fc-9387-f1eaf3341aee]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:40 devstack sudo[84672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:40 devstack sudo[84672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:40 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.547s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2dd712f9-8c36-42c4-aee4-a382693ceb70,created_at=2026-04-21T18:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155072311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2dd712f9-8c36-42c4-aee4-a382693ceb70,host='devstack@QuobyteHD#QuobyteHD',id=e5c698d7-6e67-40a2-8c64-96a8f36b2cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:40Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e60070ac-594c-4629-ba86-54b0571eed17),volume_type_id=e60070ac-594c-4629-ba86-54b0571eed17)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Creating volume e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:40 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ec27f6-6f2a-4911-945a-0588d3a13f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8427e0c-632b-4d39-9f17-240a7b1cecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Volume volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 (fe4514b4-d6c0-4417-a0a6-2e9afb078aa1): created successfully Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8427e0c-632b-4d39-9f17-240a7b1cecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Flow 'volume_create_manager' (cdef99cf-dc2c-4208-ad73-366360625d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:41 devstack sudo[84675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae 1073741824 Apr 21 20:52:41 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d5988b55-73c2-4a4c-a6ba-94ed8c3e0ee4 tempest-GroupsV314Test-687415325 None] Created volume successfully. Apr 21 20:52:41 devstack sudo[84672]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 0.725s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:41 devstack sudo[84680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee Apr 21 20:52:41 devstack sudo[84680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:41 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae 1073741824" returned: 0 in 0.897s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:41 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:52:41 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:42 devstack sudo[84680]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" returned: 0 in 0.774s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:42 devstack sudo[84693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee Apr 21 20:52:42 devstack sudo[84693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:42 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 0.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9558c0-fc66-4ba8-8944-5c398b9677b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015942c8-fd77-4cad-b517-0f1f615ce6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:42 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Volume volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae (e5c698d7-6e67-40a2-8c64-96a8f36b2cae): created successfully Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015942c8-fd77-4cad-b517-0f1f615ce6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (a20d928c-5860-4395-b32a-7f0655b34c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b19354dd-2122-4d7d-ab47-f1d81c6be1b2 tempest-GroupSnapshotsTest-1231936981 None] Created volume successfully. Apr 21 20:52:42 devstack sudo[84693]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47.d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" returned: 0 in 0.556s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee" released by "_delete_snapshot" :: held 2.766s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" released by "delete_snapshot" :: held 2.801s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Created reservations ['2793bf42-29b5-4117-9530-b469f3404cbf', 'fba3536a-68c6-4419-af0c-4d6add318a04', 'ff86ec7f-b1f7-42bc-a477-d9ca8f3e308c', '52c16720-de98-41c5-a766-6cbb59716daa'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Delete snapshot completed successfully. Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-d6201bbf-bc60-43ab-a58f-e6d2ff6c47ee-delete_snapshot" released by "delete_snapshot" :: held 2.958s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Snapshots deleted, issuing volume delete {{(pid=81991) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8518fff4-1ede-4ad4-a2c1-3ec698bcb4bb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:42 devstack sudo[84698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:42 devstack sudo[84698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:42 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Cloning volume fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 to volume fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Creating offline snapshot 84a733e0-c818-41b4-a8c3-f99978ff436b of volume fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:42 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[97945eb3-55d3-48c0-aace-e4ed5f3d95d0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:43 devstack sudo[84700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:43 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] GroupSnapshot 5b02d270-581a-4053-9651-b33313ed9878: creating. Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Group snapshot 5b02d270-581a-4053-9651-b33313ed9878: creating. {{(pid=81991) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:43 devstack sudo[84698]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 0.632s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:43 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47 Apr 21 20:52:43 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:43 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.556s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:43 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b 1G Apr 21 20:52:43 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:43 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-05c783d0-94d5-4543-bc2d-f773a20c0d47" returned: 0 in 0.519s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-05c783d0-94d5-4543-bc2d-f773a20c0d47" released by "delete_volume" :: held 1.188s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:43 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Created reservations ['a085cd97-7824-41b8-b60e-cf8b592cdafa', 'af3e96b4-2996-4a36-84ae-8529b6c2cef2', '33fa5750-78bd-4e1e-926a-193aeec73425', '59664ae3-b359-4607-8f77-9c3f6aa0bf8c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:44 devstack sudo[84716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:44 devstack sudo[84716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:44 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b 1G" returned: 0 in 0.616s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:44 devstack sudo[84718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b Apr 21 20:52:44 devstack sudo[84718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:44 devstack sudo[84716]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.437s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Deleted volume successfully. Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-12414260-8148-40b7-aeee-e5c2115d1539 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-05c783d0-94d5-4543-bc2d-f773a20c0d47-delete_volume" released by "delete_volume" :: held 10.301s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:44 devstack sudo[84718]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b" returned: 0 in 0.439s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:44 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:44 devstack sudo[84724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b Apr 21 20:52:44 devstack sudo[84724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:45 devstack sudo[84724]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b" returned: 0 in 0.423s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:45 devstack sudo[84727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info Apr 21 20:52:45 devstack sudo[84727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Flow 'volume_create_manager' (180c4388-ab75-46f3-bdbd-a52717cae7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2724a3c4-3c23-4878-93b7-c995c98f0a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2724a3c4-3c23-4878-93b7-c995c98f0a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-125909714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f93bdb-208c-4cb3-981e-e234e6b2758c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4f6b59b064773b615b81f6c721ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:45Z,use_quota=True,user_id='23f2a28e25dc44859f6fa46e033adce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425492cc-4203-479d-91d0-87284d5c8088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425492cc-4203-479d-91d0-87284d5c8088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88548c1c-3c43-4107-84d7-7028d1108c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88548c1c-3c43-4107-84d7-7028d1108c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f93bdb-208c-4cb3-981e-e234e6b2758c', 'volume_name': 'volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d1d40b-e4f3-4ca4-8a54-e57c4a3f5dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d1d40b-e4f3-4ca4-8a54-e57c4a3f5dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2977c-4866-4528-977c-4a6126fc47fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Volume f8f93bdb-208c-4cb3-981e-e234e6b2758c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c', 'volume_size': 1} Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:45 devstack sudo[84727]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info" returned: 0 in 0.564s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:45 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:45 devstack sudo[84730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info Apr 21 20:52:45 devstack sudo[84730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:46 devstack sudo[84730]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.info" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Acquiring lock "cinder-quobyte-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] snapshot: 84a733e0-c818-41b4-a8c3-f99978ff436b, volume: fe4d9706-9d4a-48f0-b314-0de1dc3eecd5, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df99a99-dbe1-4fff-843d-4f543d7431f8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:46 devstack sudo[84757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b Apr 21 20:52:46 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:46 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b" returned: 0 in 0.538s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5fda3c-0952-4cea-9b10-7b2087b353a5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:46 devstack sudo[84762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:46 devstack sudo[84762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:47 devstack sudo[84762]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.518s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:47 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:52:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:47 devstack sudo[84768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 Apr 21 20:52:47 devstack sudo[84768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:49 devstack sudo[84768]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" returned: 0 in 2.327s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:49 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9b2652-e84b-4c90-a877-a964909f9934]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:49 devstack sudo[84813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:49 devstack sudo[84813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:50 devstack sudo[84813]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.591s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:52:50 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Converted 1024.00 MB image at 439.65 MB/s Apr 21 20:52:50 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:50 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 Apr 21 20:52:50 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:50 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" returned: 0 in 0.393s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" released by "_copy_volume_from_snapshot" :: held 4.431s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=147,cinder:SELECT=109,cinder:INSERT=34,cinder:DELETE=16 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Acquiring lock "cinder-quobyte-84a733e0-c818-41b4-a8c3-f99978ff436b" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-84a733e0-c818-41b4-a8c3-f99978ff436b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Deleting offline snapshot 84a733e0-c818-41b4-a8c3-f99978ff436b of volume fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] snapshot_file for this snap is: volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3922a1a7-b5a1-438b-8e72-a055bd79ccc9]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:50 devstack sudo[84821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b Apr 21 20:52:50 devstack sudo[84821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:51 devstack sudo[84821]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b" returned: 0 in 0.535s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a0a76-4787-4898-b953-c601d80539de]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:51 devstack sudo[84828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:51 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:51 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.486s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:51 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b Apr 21 20:52:51 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:51 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:51 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:52 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:52 devstack sudo[84840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b Apr 21 20:52:52 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:52 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.591s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:52 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1.84a733e0-c818-41b4-a8c3-f99978ff436b" returned: 0 in 0.630s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-84a733e0-c818-41b4-a8c3-f99978ff436b" released by "_delete_snapshot" :: held 2.176s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=107,cinder:SELECT=117,cinder:INSERT=37,cinder:DELETE=6 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.848s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.638s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Creating offline snapshot 0095f5f6-56ca-4b47-92c7-f602aefa7ded of volume e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99dd932-b94b-420e-939d-19d5d7c94576]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:52 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-bc67dfb2-c0a9-46e7-8d0a-0bcab336b824 tempest-GroupsV314Test-687415325 None] Create group from source-group-a293dc94-2186-4ece-8b7f-bea4a80fb9d4 completed successfully. Apr 21 20:52:52 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:52:52 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:53 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 0.560s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:53 devstack sudo[84878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded 1G Apr 21 20:52:53 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:54 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded 1G" returned: 0 in 0.616s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:54 devstack sudo[84883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded Apr 21 20:52:54 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Acquiring lock "cinder-quobyte-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9423f5ed-919c-4945-9516-c33c0fcfb81f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:54 devstack sudo[84885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 Apr 21 20:52:54 devstack sudo[84885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:54 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded" returned: 0 in 0.525s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:54 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:54 devstack sudo[84891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded Apr 21 20:52:54 devstack sudo[84891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:54 devstack sudo[84885]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" returned: 0 in 0.590s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:54 devstack sudo[84896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5 Apr 21 20:52:54 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:55 devstack sudo[84891]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded" returned: 0 in 0.531s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:55 devstack sudo[84899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info Apr 21 20:52:55 devstack sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:55 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-fe4d9706-9d4a-48f0-b314-0de1dc3eecd5" released by "delete_volume" :: held 1.091s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Created reservations ['07660ab5-8ff5-46b1-913a-ca0d997bffcb'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:55 devstack cinder-volume[81991]: WARNING cinder.quota [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1246323102 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1246323102, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:55 devstack cinder-volume[81991]: WARNING cinder.quota [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1246323102 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1246323102, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Created reservations ['2a2a4c4a-2c0f-4bbf-b39b-ad2451d8b2ee', '81597a34-90f1-47a4-841f-148c88e140fa', 'a287677b-3413-498f-9ae3-c823f78df14e', '564e28df-4576-4c11-9262-de0034f0473f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:55 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:55 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:55 devstack sudo[84899]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:55 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:55 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info Apr 21 20:52:55 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:55 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:55 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-de5667b3-93de-4a91-bd87-34327a49575c tempest-GroupsV314Test-687415325 None] Delete group completed successfully. Apr 21 20:52:56 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.info" returned: 0 in 0.472s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.275s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.531s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-125909714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f93bdb-208c-4cb3-981e-e234e6b2758c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4f6b59b064773b615b81f6c721ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:52:45Z,use_quota=True,user_id='23f2a28e25dc44859f6fa46e033adce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Creating volume f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:56 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:56 devstack sudo[84933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c 1073741824 Apr 21 20:52:56 devstack sudo[84933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-de917beb-46ca-45fb-b85d-372ade5487c5 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 5b02d270-581a-4053-9651-b33313ed9878: created successfully Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Acquiring lock "cinder-quobyte-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b34bcf-a90d-4019-87ee-15292431a0cb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:56 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:56 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:56 devstack sudo[84933]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c 1073741824" returned: 0 in 0.730s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:56 devstack sudo[84964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:52:56 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:57 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.840s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:57 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.580s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:57 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1 Apr 21 20:52:57 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b2977c-4866-4528-977c-4a6126fc47fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0979911a-f994-4128-842b-9a319f1b1838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:52:57 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Volume volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c (f8f93bdb-208c-4cb3-981e-e234e6b2758c): created successfully Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0979911a-f994-4128-842b-9a319f1b1838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Flow 'volume_create_manager' (180c4388-ab75-46f3-bdbd-a52717cae7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:52:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f7f44013-e029-4b5f-903c-7b8f9276063a tempest-VolumesDeleteCascade-1580693855 None] Created volume successfully. Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-0095f5f6-56ca-4b47-92c7-f602aefa7ded-3948783b-4b36-4e10-8872-271dae80f588" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-0095f5f6-56ca-4b47-92c7-f602aefa7ded-3948783b-4b36-4e10-8872-271dae80f588" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Creating volume 3948783b-4b36-4e10-8872-271dae80f588 from snapshot 0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-3948783b-4b36-4e10-8872-271dae80f588" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-3948783b-4b36-4e10-8872-271dae80f588" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] snapshot: 0095f5f6-56ca-4b47-92c7-f602aefa7ded, volume: 3948783b-4b36-4e10-8872-271dae80f588, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[033cc72f-99e8-4dd4-8421-2fa134090f9c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:58 devstack sudo[84974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded Apr 21 20:52:58 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:58 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" returned: 0 in 0.677s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Lock "cinder-quobyte-fe4514b4-d6c0-4417-a0a6-2e9afb078aa1" released by "delete_volume" :: held 1.553s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Created reservations ['dacab851-c4c2-4440-b5cd-1484c9fb6ac3'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Created reservations ['207c192f-5c55-49c0-974f-f25ed26ad73c', '125df88f-29ef-4392-97f8-7bef8d2e6d8c', 'c1d66057-a2a0-49e6-80d4-3749150e920a', 'e3bd2083-4261-428a-a707-27ebfbceed98'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:58 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:52:58 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:58 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb67077-77dd-4a4d-9539-9a4e7cbe2da1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:52:58 devstack sudo[84982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:52:58 devstack sudo[84982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:52:58 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.526s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:58 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:52:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1450ee45-fa4b-4b9c-a040-e494121898a5 tempest-GroupsV314Test-687415325 None] Delete group completed successfully. Apr 21 20:52:59 devstack sudo[84982]: pam_unix(sudo:session): session closed for user root Apr 21 20:52:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 0.639s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:52:59 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:52:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:52:59 devstack sudo[85007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 Apr 21 20:52:59 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:01 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588" returned: 0 in 2.511s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:01 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5100eae-3282-4927-b662-1ec555382bd1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:01 devstack sudo[85026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:53:01 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 0.646s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae, size 1024.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:53:02 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Converted 1024.00 MB image at 407.37 MB/s Apr 21 20:53:02 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:02 devstack sudo[85031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 Apr 21 20:53:02 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:02 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-74f48c16-a0cb-45fe-a77e-638a6f0c26eb tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Terminate volume connection completed successfully. Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-74f48c16-a0cb-45fe-a77e-638a6f0c26eb tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Deleting attachment d457d87b-d80b-47ff-a162-3374b4765644. {{(pid=81991) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:53:02 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588" returned: 0 in 0.501s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-3948783b-4b36-4e10-8872-271dae80f588" released by "_copy_volume_from_snapshot" :: held 4.912s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-0095f5f6-56ca-4b47-92c7-f602aefa7ded-3948783b-4b36-4e10-8872-271dae80f588" released by "_create_volume_from_snapshot" :: held 4.936s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.955s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.240s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Creating offline snapshot 3aa7f20a-fad0-4786-a123-4bcf00b41074 of volume f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe89baa-6665-4414-907a-4166b7c080bf]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:02 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-333551a9-1b20-4e84-a19c-8672aacb7bd3 tempest-GroupSnapshotsTest-1231936981 None] Create group from source-snapshot-5b02d270-581a-4053-9651-b33313ed9878 completed successfully. Apr 21 20:53:02 devstack sudo[85034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:53:02 devstack sudo[85034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "cinder-f9311a94-08db-41a1-83e9-986489cca95f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-f9311a94-08db-41a1-83e9-986489cca95f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "cinder-quobyte-f9311a94-08db-41a1-83e9-986489cca95f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-quobyte-f9311a94-08db-41a1-83e9-986489cca95f" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe2aa9-fe11-4be2-a9c6-d615ac128c08]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:53:03 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack sudo[85034]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.542s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack sudo[85042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 1G Apr 21 20:53:03 devstack sudo[85042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:03 devstack sudo[85046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:53:03 devstack sudo[85046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Flow 'volume_create_manager' (7521281a-3d78-40c0-93fe-1c3f2b1d012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa05892-a53e-4916-97e4-d5c8114720d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa05892-a53e-4916-97e4-d5c8114720d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-512810111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d30c0e2-31a2-41ca-8841-4aa988db7266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d822e464fa0f4fdcaf36fb3333ae888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:04Z,use_quota=True,user_id='6484ed2483624de282fc6276c4cd6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855153a-1492-41c8-addd-7d3ac8130559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7855153a-1492-41c8-addd-7d3ac8130559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073d075a-c4a3-4f0d-b427-09ea86a2bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073d075a-c4a3-4f0d-b427-09ea86a2bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d30c0e2-31a2-41ca-8841-4aa988db7266', 'volume_name': 'volume-1d30c0e2-31a2-41ca-8841-4aa988db7266', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23506e93-4bd7-4d3f-b70e-a3821610618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23506e93-4bd7-4d3f-b70e-a3821610618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c36e849-2d6f-4372-8ce5-e1bc52aad3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:03 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Volume 1d30c0e2-31a2-41ca-8841-4aa988db7266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d30c0e2-31a2-41ca-8841-4aa988db7266', 'volume_size': 1} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-3948783b-4b36-4e10-8872-271dae80f588" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-3948783b-4b36-4e10-8872-271dae80f588" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0830bc-472c-47ab-9750-34c4dfe378ca]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[85051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 Apr 21 20:53:04 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[85042]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 1G" returned: 0 in 0.704s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 Apr 21 20:53:04 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[85046]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 1 in 0.617s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f Apr 21 20:53:04 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588" returned: 0 in 0.502s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588 Apr 21 20:53:04 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074" returned: 0 in 0.463s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 is being set with open permissions: ugo+rw Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 Apr 21 20:53:04 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f9311a94-08db-41a1-83e9-986489cca95f" returned: 0 in 0.483s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-quobyte-f9311a94-08db-41a1-83e9-986489cca95f" released by "delete_volume" :: held 1.721s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG cinder.quota [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Created reservations ['a001e4eb-ed48-4679-b6a1-725bda481201', 'daf7025e-2bb6-42f4-bb6b-4611ca0652e4', 'c55d5a03-ec79-4cbd-9155-d9d983f8919f', 'ae3268a3-8dca-44d4-87f9-d32aae2fe5b7'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:04 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:04 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:04 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074" returned: 0 in 0.466s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:04 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3948783b-4b36-4e10-8872-271dae80f588" returned: 0 in 0.535s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-3948783b-4b36-4e10-8872-271dae80f588" released by "delete_volume" :: held 1.070s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:05 devstack sudo[85075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info Apr 21 20:53:05 devstack sudo[85075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['c9c2d385-9db5-49af-b6f4-bf5d2964bb20'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:05 devstack cinder-volume[81991]: WARNING cinder.quota [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2104365389 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2104365389, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:05 devstack cinder-volume[81991]: WARNING cinder.quota [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2104365389 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2104365389, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['475aecdb-25db-4f94-9f21-bbb343a1c74c', '2b30f481-5ca8-4456-951f-0b9312b73fad', '5c3d1b53-2ad1-4bdd-81ac-d54f048ee1fa', '48b704fd-2261-4761-941d-39668837b8bf'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:05 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.502s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.manager [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:05 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Deleted volume successfully. Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-eb4946b5-4434-4268-9c58-87ea444f88f6 req-9327aa6f-0f73-4134-802a-f2f5e118e3c2 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-f9311a94-08db-41a1-83e9-986489cca95f-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:05 devstack sudo[85075]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info" returned: 0 in 0.480s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info is being set with open permissions: ugo+rw Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info Apr 21 20:53:05 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.456s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:05 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b210c374-cc2d-49ce-bac2-6b9971d1822e tempest-GroupSnapshotsTest-1231936981 None] Delete group completed successfully. Apr 21 20:53:05 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.info" returned: 0 in 0.425s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.138s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-512810111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d30c0e2-31a2-41ca-8841-4aa988db7266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d822e464fa0f4fdcaf36fb3333ae888c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:04Z,use_quota=True,user_id='6484ed2483624de282fc6276c4cd6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Creating volume 1d30c0e2-31a2-41ca-8841-4aa988db7266 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:05 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:05 devstack sudo[85098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 1073741824 Apr 21 20:53:05 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:05 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c0f054a4-a8b7-4ac0-a279-1bc8516f8c49 tempest-VolumesDeleteCascade-1580693855 None] Create snapshot completed successfully Apr 21 20:53:06 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 5b02d270-581a-4053-9651-b33313ed9878: deleting Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 5b02d270-581a-4053-9651-b33313ed9878: deleting {{(pid=81991) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-0095f5f6-56ca-4b47-92c7-f602aefa7ded" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-0095f5f6-56ca-4b47-92c7-f602aefa7ded" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Deleting offline snapshot 0095f5f6-56ca-4b47-92c7-f602aefa7ded of volume e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] snapshot_file for this snap is: volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a7cbe-a048-46e7-a266-563a049d7229]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[85107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded Apr 21 20:53:06 devstack sudo[85107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:06 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 1073741824" returned: 0 in 0.660s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[85113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 Apr 21 20:53:06 devstack sudo[85113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:06 devstack sudo[85107]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded" returned: 0 in 0.538s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f507c-d210-4bc7-86b8-e07c81e2744a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:06 devstack sudo[85118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:53:06 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack sudo[85113]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266" returned: 0 in 0.474s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c36e849-2d6f-4372-8ce5-e1bc52aad3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d30c0e2-31a2-41ca-8841-4aa988db7266', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1df51a-dc6d-498f-b8f5-70728ca348b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Volume volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 (1d30c0e2-31a2-41ca-8841-4aa988db7266): created successfully Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1df51a-dc6d-498f-b8f5-70728ca348b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Flow 'volume_create_manager' (7521281a-3d78-40c0-93fe-1c3f2b1d012a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:07 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e057843b-c9a9-42c5-9094-b2a25e1598bc tempest-VolumeQuotasNegativeTestJSON-881266537 None] Created volume successfully. Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Flow 'volume_create_manager' (52bfd592-0ab7-4172-9d54-f6a9425664d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e259ed-12ba-4aec-917a-dd15add9e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e259ed-12ba-4aec-917a-dd15add9e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-537322654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e85945-e02f-40c0-b52c-4554f3ff5e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd4f6b59b064773b615b81f6c721ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3aa7f20a-fad0-4786-a123-4bcf00b41074,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:07Z,use_quota=True,user_id='23f2a28e25dc44859f6fa46e033adce1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef0f8fd-03f2-407c-ac25-b5ba2a406dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef0f8fd-03f2-407c-ac25-b5ba2a406dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2276ae4b-1e55-4b10-ad74-42f92ca5af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2276ae4b-1e55-4b10-ad74-42f92ca5af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74e85945-e02f-40c0-b52c-4554f3ff5e05', 'volume_name': 'volume-74e85945-e02f-40c0-b52c-4554f3ff5e05', 'volume_size': 1, 'snapshot_id': '3aa7f20a-fad0-4786-a123-4bcf00b41074'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e7916d-bb90-4757-a603-31724e1bd8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e7916d-bb90-4757-a603-31724e1bd8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6f32e6-f1fe-4aa9-b064-276c5b36bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Volume 74e85945-e02f-40c0-b52c-4554f3ff5e05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74e85945-e02f-40c0-b52c-4554f3ff5e05', 'volume_size': 1, 'snapshot_id': '3aa7f20a-fad0-4786-a123-4bcf00b41074'} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-3aa7f20a-fad0-4786-a123-4bcf00b41074-74e85945-e02f-40c0-b52c-4554f3ff5e05" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-3aa7f20a-fad0-4786-a123-4bcf00b41074-74e85945-e02f-40c0-b52c-4554f3ff5e05" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Creating volume 74e85945-e02f-40c0-b52c-4554f3ff5e05 from snapshot 3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-74e85945-e02f-40c0-b52c-4554f3ff5e05" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-74e85945-e02f-40c0-b52c-4554f3ff5e05" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] snapshot: 3aa7f20a-fad0-4786-a123-4bcf00b41074, volume: 74e85945-e02f-40c0-b52c-4554f3ff5e05, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceff1ac-0692-4e19-b984-22270d1a9208]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:07 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 0.550s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:07 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 Apr 21 20:53:07 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded Apr 21 20:53:07 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:07 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074" returned: 0 in 0.624s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[05669f65-8dc0-4b93-ba1f-a90d5d57b49a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[85157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:53:08 devstack sudo[85157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded" returned: 0 in 0.676s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[85160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded Apr 21 20:53:08 devstack sudo[85160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[85157]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.628s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:08 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 Apr 21 20:53:08 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:08 devstack sudo[85160]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae.0095f5f6-56ca-4b47-92c7-f602aefa7ded" returned: 0 in 0.594s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-0095f5f6-56ca-4b47-92c7-f602aefa7ded" released by "_delete_snapshot" :: held 2.424s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" released by "delete_snapshot" :: held 2.445s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:08 devstack cinder-volume[81991]: WARNING cinder.quota [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2104365389 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2104365389, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['0622bc18-c6e0-452e-a085-e991af33d234', '20bfa097-8d33-4909-bd5c-1fb2f5ceebab', 'cc726a44-4f7a-4962-be6e-d539e1e09f42', 'ecc0df3e-c326-49f9-b125-163aa56a10cc'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Acquiring lock "cinder-1d30c0e2-31a2-41ca-8841-4aa988db7266-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "cinder-1d30c0e2-31a2-41ca-8841-4aa988db7266-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:08 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a70f40cd-7aff-4b37-b073-185aca5a5bc0 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 5b02d270-581a-4053-9651-b33313ed9878: deleted successfully Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Acquiring lock "cinder-quobyte-1d30c0e2-31a2-41ca-8841-4aa988db7266" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "cinder-quobyte-1d30c0e2-31a2-41ca-8841-4aa988db7266" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7746f99-f425-41a1-b5e7-c38ecb692576]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:09 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 Apr 21 20:53:09 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:10 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76a9c08-9cf0-4847-9e88-66941b39724e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:10 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266" returned: 0 in 1.288s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:10 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266 Apr 21 20:53:10 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:10 devstack sudo[85189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:53:10 devstack sudo[85189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1d30c0e2-31a2-41ca-8841-4aa988db7266" returned: 0 in 0.828s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05" returned: 0 in 2.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "cinder-quobyte-1d30c0e2-31a2-41ca-8841-4aa988db7266" released by "delete_volume" :: held 2.139s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[48042581-b845-41b4-9202-1aa1906c195d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Created reservations ['7e4cd05f-cb98-42ea-972a-b5f36bf16a4e', '6068d7ec-c73d-489e-a533-ae0b91628257', 'e8c5c418-23a5-434f-9ffa-af3870459233', '155706c3-0059-4610-9f30-531125e69586'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack sudo[85194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:53:11 devstack sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack sudo[85195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:11 devstack sudo[85195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack sudo[85189]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 1.286s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae Apr 21 20:53:11 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack sudo[85195]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Deleted volume successfully. Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd051b56-71e3-448d-895e-90bf2a0627fb tempest-VolumeQuotasNegativeTestJSON-881266537 None] Lock "cinder-1d30c0e2-31a2-41ca-8841-4aa988db7266-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:11 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-e5c698d7-6e67-40a2-8c64-96a8f36b2cae" released by "delete_volume" :: held 1.795s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:11 devstack sudo[85194]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.690s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:53:11 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Converted 1024.00 MB image at 417.65 MB/s Apr 21 20:53:11 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 is being set with open permissions: ugo+rw Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack sudo[85213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 Apr 21 20:53:11 devstack sudo[85213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['ccd9adbe-ac32-4f45-afc4-3b9cee91be25'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:11 devstack cinder-volume[81991]: WARNING cinder.db.sqlalchemy.api [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2104365389'] Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['e843f3bb-4c09-46e6-a489-8e4e241e6ede', 'bca90540-a522-40dd-ae98-099720dc04a8', 'dd4ff2e4-0d83-4ff9-b8ab-5ae32d0d9db5', 'ef7b10d6-1e78-43be-a8ba-85de4edbecd4'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:11 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:11 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:12 devstack sudo[85213]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-74e85945-e02f-40c0-b52c-4554f3ff5e05" released by "_copy_volume_from_snapshot" :: held 4.955s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-3aa7f20a-fad0-4786-a123-4bcf00b41074-74e85945-e02f-40c0-b52c-4554f3ff5e05" released by "_create_volume_from_snapshot" :: held 4.972s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.986s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6f32e6-f1fe-4aa9-b064-276c5b36bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e85945-e02f-40c0-b52c-4554f3ff5e05', 'volume_size': 1, 'snapshot_id': '3aa7f20a-fad0-4786-a123-4bcf00b41074'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4a2443-56a8-44ff-bfda-5590a56d746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:12 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Volume volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 (74e85945-e02f-40c0-b52c-4554f3ff5e05): created successfully Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e4a2443-56a8-44ff-bfda-5590a56d746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Flow 'volume_create_manager' (52bfd592-0ab7-4172-9d54-f6a9425664d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-28914ca2-d304-4dfb-a3af-c8569293501f tempest-VolumesDeleteCascade-1580693855 None] Created volume successfully. Apr 21 20:53:12 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3b520a43-b65e-4bab-ad51-60bf3620dd40 tempest-GroupSnapshotsTest-1231936981 None] Delete group completed successfully. Apr 21 20:53:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d5881090-2d8b-4a08-bda4-8b406b4f66b7 tempest-GroupSnapshotsTest-1231936981 None] Group tempest-GroupSnapshotsTest-Group-1266040484: creating Apr 21 20:53:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d5881090-2d8b-4a08-bda4-8b406b4f66b7 tempest-GroupSnapshotsTest-1231936981 None] Group tempest-GroupSnapshotsTest-Group-1266040484: created successfully Apr 21 20:53:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d5881090-2d8b-4a08-bda4-8b406b4f66b7 tempest-GroupSnapshotsTest-1231936981 None] Create group completed successfully. Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-f8f93bdb-208c-4cb3-981e-e234e6b2758c-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-f8f93bdb-208c-4cb3-981e-e234e6b2758c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Performing cascade delete. {{(pid=81991) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-3aa7f20a-fad0-4786-a123-4bcf00b41074-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-3aa7f20a-fad0-4786-a123-4bcf00b41074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-f8f93bdb-208c-4cb3-981e-e234e6b2758c" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-f8f93bdb-208c-4cb3-981e-e234e6b2758c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-3aa7f20a-fad0-4786-a123-4bcf00b41074" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-3aa7f20a-fad0-4786-a123-4bcf00b41074" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Deleting offline snapshot 3aa7f20a-fad0-4786-a123-4bcf00b41074 of volume f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] snapshot_file for this snap is: volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba280c-f6b2-40bc-a0af-91898e4a5a3f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 Apr 21 20:53:13 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074" returned: 0 in 0.561s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[46491535-db2d-4039-9b74-a1633f0f2165]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[85254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:53:13 devstack sudo[85254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (2dc3a251-37ef-4e2e-ad74-047e33b5ec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec46b515-e341-4f6a-991a-0b00fa66a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec46b515-e341-4f6a-991a-0b00fa66a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498899435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdf15993-f8fa-45d9-8cb9-e642eb3b0735,host='devstack@QuobyteHD#QuobyteHD',id=63ef7b8b-ab59-42b5-9c82-a951b2f21d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:14Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71d3d661-da9c-49eb-a6f9-cf2a46573c41),volume_type_id=71d3d661-da9c-49eb-a6f9-cf2a46573c41)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722587bb-93ae-4366-b033-6c0050184a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722587bb-93ae-4366-b033-6c0050184a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1918aeb5-f0f5-417e-b188-3695b87a7047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1918aeb5-f0f5-417e-b188-3695b87a7047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ef7b8b-ab59-42b5-9c82-a951b2f21d64', 'volume_name': 'volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12ac305-5499-4c62-ae18-85d0ff81bbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12ac305-5499-4c62-ae18-85d0ff81bbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ffc46a-31af-46c2-b20c-1d5701c86236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:13 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Volume 63ef7b8b-ab59-42b5-9c82-a951b2f21d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64', 'volume_size': 1} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdf15993-f8fa-45d9-8cb9-e642eb3b0735,created_at=2026-04-21T18:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-498899435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdf15993-f8fa-45d9-8cb9-e642eb3b0735,host='devstack@QuobyteHD#QuobyteHD',id=63ef7b8b-ab59-42b5-9c82-a951b2f21d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:14Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71d3d661-da9c-49eb-a6f9-cf2a46573c41),volume_type_id=71d3d661-da9c-49eb-a6f9-cf2a46573c41)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Creating volume 63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:13 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:13 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 1073741824 Apr 21 20:53:13 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:14 devstack sudo[85254]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.709s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:14 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 Apr 21 20:53:14 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:14 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 1073741824" returned: 0 in 0.678s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:14 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 Apr 21 20:53:14 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:14 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074" returned: 0 in 0.664s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:14 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074 Apr 21 20:53:14 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:15 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" returned: 0 in 0.541s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ffc46a-31af-46c2-b20c-1d5701c86236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae809a2-d195-4e30-96a9-0c1d9a12bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Volume volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 (63ef7b8b-ab59-42b5-9c82-a951b2f21d64): created successfully Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae809a2-d195-4e30-96a9-0c1d9a12bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (2dc3a251-37ef-4e2e-ad74-047e33b5ec12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b5fd4c06-5e06-4853-bf15-0ea20f64b959 tempest-GroupSnapshotsTest-1231936981 None] Created volume successfully. Apr 21 20:53:15 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c.3aa7f20a-fad0-4786-a123-4bcf00b41074" returned: 0 in 0.476s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-3aa7f20a-fad0-4786-a123-4bcf00b41074" released by "_delete_snapshot" :: held 2.459s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-f8f93bdb-208c-4cb3-981e-e234e6b2758c" released by "delete_snapshot" :: held 2.472s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Created reservations ['3a19c916-4c7b-402d-9561-75f267c81299', '72300b89-4900-428b-bf30-7fa3deb65ab3', 'd44195c6-72b3-4ec1-9f7d-acfbfa3d0910', '1a89d4fe-e45b-4198-883d-b70e808d2d1e'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Delete snapshot completed successfully. Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-3aa7f20a-fad0-4786-a123-4bcf00b41074-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Snapshots deleted, issuing volume delete {{(pid=81991) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-f8f93bdb-208c-4cb3-981e-e234e6b2758c" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-f8f93bdb-208c-4cb3-981e-e234e6b2758c" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[391767c6-753d-41c4-8f6c-e6bb658ab65f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:15 devstack sudo[85303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:53:15 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:16 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.598s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:16 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c Apr 21 20:53:16 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (2d5749ff-9210-42e1-b53c-3c1a59c4ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf79668-7505-4392-9608-621cdff3b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf79668-7505-4392-9608-621cdff3b206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1209515336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdf15993-f8fa-45d9-8cb9-e642eb3b0735,host='devstack@QuobyteHD#QuobyteHD',id=a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:16Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71d3d661-da9c-49eb-a6f9-cf2a46573c41),volume_type_id=71d3d661-da9c-49eb-a6f9-cf2a46573c41)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914a24e7-f895-4995-97b8-1051facaddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914a24e7-f895-4995-97b8-1051facaddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf81d8dc-1038-4c20-b92c-f68ac58e949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf81d8dc-1038-4c20-b92c-f68ac58e949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e', 'volume_name': 'volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8ce88a-0212-45e2-8c2a-dbb70e3b00a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8ce88a-0212-45e2-8c2a-dbb70e3b00a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be78a0a-a8fa-451a-81c9-3e2905188a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:16 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Volume a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e', 'volume_size': 1} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdf15993-f8fa-45d9-8cb9-e642eb3b0735,created_at=2026-04-21T18:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1209515336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdf15993-f8fa-45d9-8cb9-e642eb3b0735,host='devstack@QuobyteHD#QuobyteHD',id=a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:16Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71d3d661-da9c-49eb-a6f9-cf2a46573c41),volume_type_id=71d3d661-da9c-49eb-a6f9-cf2a46573c41)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Creating volume a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:16 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:16 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e 1073741824 Apr 21 20:53:16 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:16 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f8f93bdb-208c-4cb3-981e-e234e6b2758c" returned: 0 in 0.533s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-f8f93bdb-208c-4cb3-981e-e234e6b2758c" released by "delete_volume" :: held 1.173s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Created reservations ['358aeda1-40a5-4408-b352-177adb0894ed', '92009f21-c46f-4abd-a676-cf96dae23b6e', 'ed6274dd-e84e-46fb-b187-1bb92f992750', 'efd74a8d-1d51-4516-b293-7a529317f879'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-26f47692-500f-4544-bf96-ee226dc04bcf req-9f81b7e0-0019-43ff-adfe-bf476164bb58 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Terminate volume connection completed successfully. Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-26f47692-500f-4544-bf96-ee226dc04bcf req-9f81b7e0-0019-43ff-adfe-bf476164bb58 tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Deleting attachment 60115091-69c9-4b06-95f2-ab9d70b24be8. {{(pid=81991) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:16 devstack sudo[85317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:16 devstack sudo[85317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:17 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e 1073741824" returned: 0 in 0.639s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:17 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e Apr 21 20:53:17 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:17 devstack sudo[85317]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "cinder-e97777c1-10fd-482c-8d22-8230f0189e22-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.581s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-e97777c1-10fd-482c-8d22-8230f0189e22-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Deleted volume successfully. Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-74e85945-e02f-40c0-b52c-4554f3ff5e05-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-74e85945-e02f-40c0-b52c-4554f3ff5e05-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-df0c3e08-faef-4d39-8606-ddd8f57de380 tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-f8f93bdb-208c-4cb3-981e-e234e6b2758c-delete_volume" released by "delete_volume" :: held 4.623s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "cinder-quobyte-e97777c1-10fd-482c-8d22-8230f0189e22" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-quobyte-e97777c1-10fd-482c-8d22-8230f0189e22" acquired by "delete_volume" :: waited 0.026s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf11cd5-8a77-4b34-9c0a-9d69c67103f6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "cinder-quobyte-74e85945-e02f-40c0-b52c-4554f3ff5e05" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-74e85945-e02f-40c0-b52c-4554f3ff5e05" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9b07d-f898-486e-8fa8-4b0f80777e27]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:17 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 Apr 21 20:53:17 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:17 devstack sudo[85326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 Apr 21 20:53:17 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:17 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" returned: 0 in 0.655s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3be78a0a-a8fa-451a-81c9-3e2905188a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3315b8-5eb1-4eeb-a6d9-b58457a7224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:17 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Volume volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e (a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e): created successfully Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3315b8-5eb1-4eeb-a6d9-b58457a7224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (2d5749ff-9210-42e1-b53c-3c1a59c4ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e42058b0-acbf-4e79-88d8-60989308fc38 tempest-GroupSnapshotsTest-1231936981 None] Created volume successfully. Apr 21 20:53:18 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05" returned: 0 in 0.617s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:18 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05 Apr 21 20:53:18 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:18 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22" returned: 0 in 0.694s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:18 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22 Apr 21 20:53:18 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:18 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-69e64dcc-2860-440e-98b2-2a8a09c53e32 tempest-GroupSnapshotsTest-1231936981 None] Update group completed successfully. Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-74e85945-e02f-40c0-b52c-4554f3ff5e05" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-quobyte-74e85945-e02f-40c0-b52c-4554f3ff5e05" released by "delete_volume" :: held 1.132s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Created reservations ['3de5e298-f923-4c5a-907f-ed26ca2d9d38', '6ef16ff5-2267-4f76-a96f-fc561619c56b', 'faee1174-b082-4c1c-883d-e2a6a2bf7c75', '75bc34a3-a2c3-49be-b599-459338f0ac67'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:18 devstack sudo[85342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:18 devstack sudo[85342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:18 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e97777c1-10fd-482c-8d22-8230f0189e22" returned: 0 in 0.615s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-quobyte-e97777c1-10fd-482c-8d22-8230f0189e22" released by "delete_volume" :: held 1.336s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.quota [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Created reservations ['690f3bac-5b5a-4a22-b22c-cfa9d0dc4649', 'aebea43d-c312-4ce4-a88f-eef8f1a372a4', 'f9e1198f-617e-44ca-936f-8d99118cf95a', '5aa53d8b-d602-4997-9eb2-e0860e8efb89'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:18 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:18 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:19 devstack sudo[85342]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.532s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:19 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:19 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Deleted volume successfully. Apr 21 20:53:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2610c6d9-a0e5-4e71-9ef3-738b3905868d tempest-VolumesDeleteCascade-1580693855 None] Lock "cinder-74e85945-e02f-40c0-b52c-4554f3ff5e05-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:19 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.597s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:19 devstack cinder-volume[81991]: DEBUG cinder.manager [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:19 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Deleted volume successfully. Apr 21 20:53:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-26f47692-500f-4544-bf96-ee226dc04bcf req-c9ccee45-d588-4b55-b478-e67e479928ed tempest-ServerBootFromVolumeStableRescueTest-291748519 None] Lock "cinder-e97777c1-10fd-482c-8d22-8230f0189e22-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:19 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-94fdcadd-1c18-4772-b8c6-28245e6f8f42 tempest-GroupSnapshotsTest-1231936981 None] Update group completed successfully. Apr 21 20:53:21 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3139acfa-d5ef-4403-80d6-256dcc57e1b1 tempest-GroupSnapshotsTest-1231936981 None] Update group completed successfully. Apr 21 20:53:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-06b75608-9b4d-43d6-8cfc-1a541c5c4b92 tempest-GroupSnapshotsTest-1231936981 None] Update group completed successfully. Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Flow 'volume_create_manager' (ff5b6d88-8068-4575-9445-c24219a5bb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d0ea88-4ac5-4643-8d8c-fddba02b2bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d0ea88-4ac5-4643-8d8c-fddba02b2bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-931562325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88581a9-f7ec-4f3e-b79e-c52828d77f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4acd43600ec449cbb437ab33200f266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:22Z,use_quota=True,user_id='992d86fab7a94801ad9f1c9f703af155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bccb1a-0f79-4a73-9de2-438e08b0bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bccb1a-0f79-4a73-9de2-438e08b0bcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a6ee50-a30b-4909-8017-36df6e31683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a6ee50-a30b-4909-8017-36df6e31683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88581a9-f7ec-4f3e-b79e-c52828d77f90', 'volume_name': 'volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5efc31e-2da0-45c0-bb54-04020f283786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5efc31e-2da0-45c0-bb54-04020f283786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6806f31-cce2-49e1-bb79-64e490a1207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:22 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Volume c88581a9-f7ec-4f3e-b79e-c52828d77f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90', 'volume_size': 1} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-931562325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88581a9-f7ec-4f3e-b79e-c52828d77f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4acd43600ec449cbb437ab33200f266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:22Z,use_quota=True,user_id='992d86fab7a94801ad9f1c9f703af155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Creating volume c88581a9-f7ec-4f3e-b79e-c52828d77f90 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:22 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:22 devstack sudo[85380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 1073741824 Apr 21 20:53:22 devstack sudo[85380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:22 devstack sudo[85380]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 1073741824" returned: 0 in 0.617s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:22 devstack sudo[85386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 Apr 21 20:53:22 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:23 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] GroupSnapshot 58c1ddf9-3e93-4e56-a3f5-1423e38cd0d8: creating. Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90" returned: 0 in 0.614s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6806f31-cce2-49e1-bb79-64e490a1207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfea3b3-3e51-442a-9e4b-3540ac289a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Group snapshot 58c1ddf9-3e93-4e56-a3f5-1423e38cd0d8: creating. {{(pid=81991) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:53:23 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Volume volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 (c88581a9-f7ec-4f3e-b79e-c52828d77f90): created successfully Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfea3b3-3e51-442a-9e4b-3540ac289a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Flow 'volume_create_manager' (ff5b6d88-8068-4575-9445-c24219a5bb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Creating offline snapshot b2da3261-ffeb-4e95-8d53-d10d77dfb30f of volume a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2783c33a-d45c-4a0f-8ded-c4dffaf193ea tempest-VolumesMetadataTest-887610690 None] Created volume successfully. Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[01562a9c-f8c4-403a-a9c4-1e5b42f41144]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:23 devstack sudo[85391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e Apr 21 20:53:23 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:24 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" returned: 0 in 0.566s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:24 devstack sudo[85397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f 1G Apr 21 20:53:24 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:24 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f 1G" returned: 0 in 0.610s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:24 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f Apr 21 20:53:24 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Acquiring lock "cinder-c88581a9-f7ec-4f3e-b79e-c52828d77f90-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Lock "cinder-c88581a9-f7ec-4f3e-b79e-c52828d77f90-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Acquiring lock "cinder-quobyte-c88581a9-f7ec-4f3e-b79e-c52828d77f90" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Lock "cinder-quobyte-c88581a9-f7ec-4f3e-b79e-c52828d77f90" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f816617-8821-4b2f-b89f-e7b17fc60f6f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:25 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 Apr 21 20:53:25 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f" returned: 0 in 0.542s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:25 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:25 devstack sudo[85409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f Apr 21 20:53:25 devstack sudo[85409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90" returned: 0 in 0.743s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:25 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90 Apr 21 20:53:25 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:25 devstack sudo[85409]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f" returned: 0 in 0.544s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:25 devstack sudo[85417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info Apr 21 20:53:25 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:26 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c88581a9-f7ec-4f3e-b79e-c52828d77f90" returned: 0 in 0.518s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Lock "cinder-quobyte-c88581a9-f7ec-4f3e-b79e-c52828d77f90" released by "delete_volume" :: held 1.285s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:26 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:26 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:26 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info Apr 21 20:53:26 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Created reservations ['711fc94f-6cf1-4033-9a6a-82fb1e78cb09', '22f1b4ef-a060-42b6-9303-8d2ab9c1fd7c', '7dca667e-05bf-41c2-ab9d-2628be336bbf', '58478685-01d0-44f6-a6fe-41a19dbe27ba'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:26 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:26 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:26 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.info" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.264s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Creating offline snapshot efcb3639-7007-4399-9935-1dfab0ee2f76 of volume 63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef839bd-f0bc-473d-b3de-daa9f198014d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:26 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.501s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Deleted volume successfully. Apr 21 20:53:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ae7ef940-727d-44b9-aa57-3564e7517e6f tempest-VolumesMetadataTest-887610690 None] Lock "cinder-c88581a9-f7ec-4f3e-b79e-c52828d77f90-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:27 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 Apr 21 20:53:27 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:27 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" returned: 0 in 0.648s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:27 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 1G Apr 21 20:53:27 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:28 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 1G" returned: 0 in 0.640s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:28 devstack sudo[85438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 Apr 21 20:53:28 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:28 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76" returned: 0 in 0.613s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:28 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:28 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 Apr 21 20:53:28 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:29 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76" returned: 0 in 0.573s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:29 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info Apr 21 20:53:29 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:29 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info" returned: 0 in 0.523s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:29 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:29 devstack sudo[85450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info Apr 21 20:53:29 devstack sudo[85450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:30 devstack sudo[85450]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.info" returned: 0 in 0.530s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.597s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:30 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0a1dbd24-5ae8-4757-af83-7a6b3f342695 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 58c1ddf9-3e93-4e56-a3f5-1423e38cd0d8: created successfully Apr 21 20:53:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 58c1ddf9-3e93-4e56-a3f5-1423e38cd0d8: deleting Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 58c1ddf9-3e93-4e56-a3f5-1423e38cd0d8: deleting {{(pid=81991) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-b2da3261-ffeb-4e95-8d53-d10d77dfb30f" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-b2da3261-ffeb-4e95-8d53-d10d77dfb30f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Deleting offline snapshot b2da3261-ffeb-4e95-8d53-d10d77dfb30f of volume a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] snapshot_file for this snap is: volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f00c9a-8682-4078-808d-b59656917809]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:31 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f Apr 21 20:53:31 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Flow 'volume_create_manager' (05445088-b1c7-40d1-8d9e-778ca7238082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b0c981-de17-45bb-83a6-9e981d45c4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7b0c981-de17-45bb-83a6-9e981d45c4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1975595336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bffc525-8862-46d7-896a-b5a9653d23a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad13f8cc7b38438788718dc7d74d2f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:32Z,use_quota=True,user_id='043a1f64ebee4a8dbe742b57169fd67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18a2505-e145-4752-b757-4e355460d75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18a2505-e145-4752-b757-4e355460d75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b7a294-f1b8-47c5-92b2-43b49736035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40b7a294-f1b8-47c5-92b2-43b49736035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bffc525-8862-46d7-896a-b5a9653d23a0', 'volume_name': 'volume-8bffc525-8862-46d7-896a-b5a9653d23a0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecbd1e4-9982-4ea6-af5d-359d2dafee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecbd1e4-9982-4ea6-af5d-359d2dafee42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874f6695-ba40-4b31-abff-64eda7dc70a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:31 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Volume 8bffc525-8862-46d7-896a-b5a9653d23a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bffc525-8862-46d7-896a-b5a9653d23a0', 'volume_size': 1} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1975595336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bffc525-8862-46d7-896a-b5a9653d23a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad13f8cc7b38438788718dc7d74d2f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:32Z,use_quota=True,user_id='043a1f64ebee4a8dbe742b57169fd67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Creating volume 8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:31 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:31 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 1073741824 Apr 21 20:53:31 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:31 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f" returned: 0 in 0.690s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ec223-a15f-4278-8ee3-021c6905308a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:31 devstack sudo[85461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e Apr 21 20:53:31 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 1073741824" returned: 0 in 0.613s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:53:32 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" returned: 0 in 0.658s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:32 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f Apr 21 20:53:32 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Flow 'volume_create_manager' (2cfae52b-006f-4511-b6dc-7fb23ea0c552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64416112-55fb-481f-bc70-8ead458cec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64416112-55fb-481f-bc70-8ead458cec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1744478138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5f3310-e541-4f83-b161-3e324551d926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd1f9b245624f5e8a2bfa4bdbab09cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:33Z,use_quota=True,user_id='f83bf68acee2495ea0b7da599e24a031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e46476-7e90-4e1f-a23a-d6de603d6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e46476-7e90-4e1f-a23a-d6de603d6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceb1580-d142-4c7e-890f-40a7bb917589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aceb1580-d142-4c7e-890f-40a7bb917589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5f3310-e541-4f83-b161-3e324551d926', 'volume_name': 'volume-ff5f3310-e541-4f83-b161-3e324551d926', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5261b828-0acf-4e09-aff7-08c1b265d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5261b828-0acf-4e09-aff7-08c1b265d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79fe54d-9409-4a3f-8bf6-79836d5afedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:32 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Volume ff5f3310-e541-4f83-b161-3e324551d926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5f3310-e541-4f83-b161-3e324551d926', 'volume_size': 1} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.610s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1744478138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5f3310-e541-4f83-b161-3e324551d926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd1f9b245624f5e8a2bfa4bdbab09cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:33Z,use_quota=True,user_id='f83bf68acee2495ea0b7da599e24a031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Creating volume ff5f3310-e541-4f83-b161-3e324551d926 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:33 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874f6695-ba40-4b31-abff-64eda7dc70a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bffc525-8862-46d7-896a-b5a9653d23a0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:33 devstack sudo[85477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 1073741824 Apr 21 20:53:33 devstack sudo[85477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74857163-5f23-46ac-9277-06381e44fc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:33 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Volume volume-8bffc525-8862-46d7-896a-b5a9653d23a0 (8bffc525-8862-46d7-896a-b5a9653d23a0): created successfully Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74857163-5f23-46ac-9277-06381e44fc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Flow 'volume_create_manager' (05445088-b1c7-40d1-8d9e-778ca7238082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:33 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-373daaa1-4a90-4b40-9ded-dfef1436196d tempest-VolumesActionsTest-1598520617 None] Created volume successfully. Apr 21 20:53:33 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f" returned: 0 in 0.590s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:33 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f Apr 21 20:53:33 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:33 devstack sudo[85477]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 1073741824" returned: 0 in 0.538s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:33 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 Apr 21 20:53:33 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:33 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e.b2da3261-ffeb-4e95-8d53-d10d77dfb30f" returned: 0 in 0.558s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-b2da3261-ffeb-4e95-8d53-d10d77dfb30f" released by "_delete_snapshot" :: held 2.580s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" released by "delete_snapshot" :: held 2.598s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-efcb3639-7007-4399-9935-1dfab0ee2f76" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-efcb3639-7007-4399-9935-1dfab0ee2f76" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Deleting offline snapshot efcb3639-7007-4399-9935-1dfab0ee2f76 of volume 63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] snapshot_file for this snap is: volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4236df38-c1b9-4c35-b440-227a9644673a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:33 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 Apr 21 20:53:33 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:34 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926" returned: 0 in 0.585s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79fe54d-9409-4a3f-8bf6-79836d5afedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5f3310-e541-4f83-b161-3e324551d926', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2aec6f-9c70-4726-b893-ac5a9ecebd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:34 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Volume volume-ff5f3310-e541-4f83-b161-3e324551d926 (ff5f3310-e541-4f83-b161-3e324551d926): created successfully Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2aec6f-9c70-4726-b893-ac5a9ecebd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Flow 'volume_create_manager' (2cfae52b-006f-4511-b6dc-7fb23ea0c552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:34 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e727fd6a-2159-4dc8-96a5-a9c394f3fbd6 tempest-VolumesTransfersV355Test-112702598 None] Created volume successfully. Apr 21 20:53:34 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76" returned: 0 in 0.648s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cdd2bd-1f78-43b8-ae8b-88a3745203b9]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:34 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 Apr 21 20:53:34 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:34 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:35 devstack sudo[85502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 Apr 21 20:53:35 devstack sudo[85502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:35 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-888710b2-13e5-4b9e-8413-b44f8b85e670 tempest-VolumesTransfersV355Test-32830197 None] Transfer volume completed successfully. Apr 21 20:53:35 devstack sudo[85502]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76" returned: 0 in 0.550s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:35 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76 Apr 21 20:53:35 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:35 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64.efcb3639-7007-4399-9935-1dfab0ee2f76" returned: 0 in 0.430s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-efcb3639-7007-4399-9935-1dfab0ee2f76" released by "_delete_snapshot" :: held 2.237s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" released by "delete_snapshot" :: held 2.256s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:36 devstack cinder-volume[81991]: WARNING cinder.quota [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1647417164 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1647417164, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:36 devstack cinder-volume[81991]: WARNING cinder.quota [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1647417164 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1647417164, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['b1cb4581-a821-4231-8cb3-61e1f7f9f05d', 'e7b41fe2-f619-4497-8575-a21c4079bdca', '2e2a2862-96a5-4a9e-bb0e-2f4a938758e4', '9629af71-2600-4ad2-8108-68274cf0f7ce'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['dd51d1f6-c4c6-425b-8159-9cf3b2343d79', '18ec9a7d-d628-4f68-982e-46dc8da3904a', '72e9c4e5-cf59-4a37-bdd9-9d99b9c140a8', 'd8ad355b-2789-425b-b37d-96dc16cf4929'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:36 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7a6d23aa-e6f6-40c7-a6e0-6b5a0975aa50 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 58c1ddf9-3e93-4e56-a3f5-1423e38cd0d8: deleted successfully Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Acquiring lock "cinder-ff5f3310-e541-4f83-b161-3e324551d926-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-ff5f3310-e541-4f83-b161-3e324551d926-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Acquiring lock "cinder-quobyte-ff5f3310-e541-4f83-b161-3e324551d926" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-quobyte-ff5f3310-e541-4f83-b161-3e324551d926" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7f4fb-dd4d-49f8-86dd-f33f70e21ef4]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 Apr 21 20:53:36 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf618095-cfc3-46b9-94b4-bb0f431fc841]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:36 devstack sudo[85514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 Apr 21 20:53:36 devstack sudo[85514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926" returned: 0 in 0.704s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:37 devstack sudo[85519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926 Apr 21 20:53:37 devstack sudo[85519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack sudo[85514]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" returned: 0 in 0.710s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:37 devstack sudo[85524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64 Apr 21 20:53:37 devstack sudo[85524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:37 devstack sudo[85519]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ff5f3310-e541-4f83-b161-3e324551d926" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-quobyte-ff5f3310-e541-4f83-b161-3e324551d926" released by "delete_volume" :: held 1.232s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Created reservations ['1d173814-3c0d-44e6-b449-7b540f346b32', '0918aa2d-7f0b-4355-bfb8-cb72f9c8e80b', 'b0432c88-bd24-4a6b-838e-b5a322af5ba9', 'ab4a1f7f-6d2a-4abd-ac04-e5f17a76c054'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:37 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:37 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:38 devstack sudo[85524]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" returned: 0 in 0.641s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-63ef7b8b-ab59-42b5-9c82-a951b2f21d64" released by "delete_volume" :: held 1.392s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8edd4-593b-4fae-8af3-ccbae5a7c521]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:38 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e Apr 21 20:53:38 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:38 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:38 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Deleted volume successfully. Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e373b129-a574-47bf-aed0-b5d3660ff931 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-ff5f3310-e541-4f83-b161-3e324551d926-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:38 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" returned: 0 in 0.575s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:38 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e Apr 21 20:53:38 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Flow 'volume_create_manager' (d6cc0e1e-1cbf-451c-82ee-8a8c6af07f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859fbdda-53aa-48bb-a90a-3cafa361624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859fbdda-53aa-48bb-a90a-3cafa361624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1028378778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb7312e-c5b7-4fdd-96ef-3852bedc960a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd1f9b245624f5e8a2bfa4bdbab09cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:39Z,use_quota=True,user_id='f83bf68acee2495ea0b7da599e24a031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282f43a4-cd8b-439c-ac11-00f472502860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282f43a4-cd8b-439c-ac11-00f472502860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a4225f-4762-4dea-b05b-8fbc98195c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a4225f-4762-4dea-b05b-8fbc98195c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb7312e-c5b7-4fdd-96ef-3852bedc960a', 'volume_name': 'volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8844dfae-1bbe-4702-a1ac-f3c75746baac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8844dfae-1bbe-4702-a1ac-f3c75746baac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9c29a9-4e8c-4619-8ed4-872fc0b10121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:39 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Volume 0bb7312e-c5b7-4fdd-96ef-3852bedc960a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a', 'volume_size': 1} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1028378778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb7312e-c5b7-4fdd-96ef-3852bedc960a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd1f9b245624f5e8a2bfa4bdbab09cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:39Z,use_quota=True,user_id='f83bf68acee2495ea0b7da599e24a031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Creating volume 0bb7312e-c5b7-4fdd-96ef-3852bedc960a {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:39 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a 1073741824 Apr 21 20:53:39 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:39 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" returned: 0 in 0.629s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-a9f54e21-aa6d-49e8-9a99-68bd6dfdd37e" released by "delete_volume" :: held 1.239s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['c7d9e882-47a5-4226-b6f3-9285880ccf15'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:39 devstack cinder-volume[81991]: WARNING cinder.quota [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1647417164 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1647417164, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['84e0d798-d1bb-4ed0-b986-d05628d6bb16', '3a5ebda8-ac5e-434c-9d40-025f47cd5cfb', '7d1c6326-14a1-4a5b-90e5-b9afb2be0cf2', '2174ad60-ceed-44ad-a065-06c701098d07'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['a234dc24-492e-4e58-acb4-6e3173a6d645', '14c03b7c-3fa4-4d0d-81bb-172005813bb7', '1f570575-e9fd-44e0-b72e-c825a555616a', 'f7b80119-b418-439e-9fd5-01ac5a6860e0'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:39 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:39 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a 1073741824" returned: 0 in 0.655s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:39 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a Apr 21 20:53:39 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:40 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.680s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1dd999da-8715-4eb9-9c87-bf1e018ff731 tempest-GroupSnapshotsTest-1231936981 None] Delete group completed successfully. Apr 21 20:53:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fed853d1-13e7-4a3c-8b69-36f427c84778 tempest-GroupSnapshotsTest-1231936981 None] Group tempest-GroupSnapshotsTest-Group-817331116: creating Apr 21 20:53:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fed853d1-13e7-4a3c-8b69-36f427c84778 tempest-GroupSnapshotsTest-1231936981 None] Group tempest-GroupSnapshotsTest-Group-817331116: created successfully Apr 21 20:53:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fed853d1-13e7-4a3c-8b69-36f427c84778 tempest-GroupSnapshotsTest-1231936981 None] Create group completed successfully. Apr 21 20:53:40 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a" returned: 0 in 0.664s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac9c29a9-4e8c-4619-8ed4-872fc0b10121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7910f-6910-47b6-b6a6-d8270c90b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:40 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Volume volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a (0bb7312e-c5b7-4fdd-96ef-3852bedc960a): created successfully Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f7910f-6910-47b6-b6a6-d8270c90b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Flow 'volume_create_manager' (d6cc0e1e-1cbf-451c-82ee-8a8c6af07f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5a4ea9c1-e307-4b88-ae5e-b71ab715d8a0 tempest-VolumesTransfersV355Test-112702598 None] Created volume successfully. Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Acquiring lock "cinder-0bb7312e-c5b7-4fdd-96ef-3852bedc960a-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-0bb7312e-c5b7-4fdd-96ef-3852bedc960a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Acquiring lock "cinder-quobyte-0bb7312e-c5b7-4fdd-96ef-3852bedc960a" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-quobyte-0bb7312e-c5b7-4fdd-96ef-3852bedc960a" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb8559-99eb-4135-a3b2-f7e684aa61a2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:41 devstack sudo[85576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a Apr 21 20:53:41 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (40a79ada-72a9-4f01-b40d-5408a6d75277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079ed661-007a-481a-8459-d1ad39e79b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079ed661-007a-481a-8459-d1ad39e79b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-836853880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14998972-cf42-4bff-8580-12b0335b686b,host='devstack@QuobyteHD#QuobyteHD',id=2c2c53b4-4989-43f2-a481-34b578d7ae9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:42Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee23da7e-9950-43dd-b95f-5256c14d957c),volume_type_id=ee23da7e-9950-43dd-b95f-5256c14d957c)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd76648-8c8d-4644-95db-e65f7fe1b485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd76648-8c8d-4644-95db-e65f7fe1b485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d516c57-8c0e-44f5-b75e-b5d78bcf2ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d516c57-8c0e-44f5-b75e-b5d78bcf2ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c2c53b4-4989-43f2-a481-34b578d7ae9a', 'volume_name': 'volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c611ca9-3881-486d-92f1-cba0735071ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c611ca9-3881-486d-92f1-cba0735071ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55372683-123b-47ac-b0a0-8c665f81b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Volume 2c2c53b4-4989-43f2-a481-34b578d7ae9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a', 'volume_size': 1} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14998972-cf42-4bff-8580-12b0335b686b,created_at=2026-04-21T18:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-836853880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14998972-cf42-4bff-8580-12b0335b686b,host='devstack@QuobyteHD#QuobyteHD',id=2c2c53b4-4989-43f2-a481-34b578d7ae9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c94d135cc254a59890be3831272675a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:42Z,use_quota=True,user_id='7fc126dc594946c7afe99f9583941cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee23da7e-9950-43dd-b95f-5256c14d957c),volume_type_id=ee23da7e-9950-43dd-b95f-5256c14d957c)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Creating volume 2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:41 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:41 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a 1073741824 Apr 21 20:53:41 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a" returned: 0 in 0.601s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:42 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a Apr 21 20:53:42 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a 1073741824" returned: 0 in 0.524s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:42 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a Apr 21 20:53:42 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0bb7312e-c5b7-4fdd-96ef-3852bedc960a" returned: 0 in 0.439s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-quobyte-0bb7312e-c5b7-4fdd-96ef-3852bedc960a" released by "delete_volume" :: held 1.064s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Created reservations ['ecbd9e45-f482-4e5d-b82a-3bdcc10232b4', 'a8e7009a-3f3e-4ea7-975c-d34d4aa98903', '115115dd-820e-489a-b2a5-427e32b7dd3b', '424c3fd8-8d76-483d-9ec5-e9f652f9bfc6'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:42 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:42 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:42 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a" returned: 0 in 0.487s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55372683-123b-47ac-b0a0-8c665f81b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5436042f-1eee-44ac-b4a4-82f1f302b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:42 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Volume volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a (2c2c53b4-4989-43f2-a481-34b578d7ae9a): created successfully Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5436042f-1eee-44ac-b4a4-82f1f302b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:42 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Flow 'volume_create_manager' (40a79ada-72a9-4f01-b40d-5408a6d75277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-792011e6-d166-4a71-9135-b339c9040ce3 tempest-GroupSnapshotsTest-1231936981 None] Created volume successfully. Apr 21 20:53:43 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.441s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:43 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Deleted volume successfully. Apr 21 20:53:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-713d28fd-8d63-41f9-afa2-0fd79c2c97d2 tempest-VolumesTransfersV355Test-953424884 None] Lock "cinder-0bb7312e-c5b7-4fdd-96ef-3852bedc960a-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] GroupSnapshot 2a6a00f6-95fe-4d5a-8d27-462fc6bdd91f: creating. Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Group snapshot 2a6a00f6-95fe-4d5a-8d27-462fc6bdd91f: creating. {{(pid=81991) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Creating offline snapshot e3eec031-ad81-432c-bdd7-bd3f9253968d of volume 2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[552fbe51-9c2b-4cce-a55c-1956e9dbeefd]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:44 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a Apr 21 20:53:44 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:44 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a" returned: 0 in 0.549s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:44 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d 1G Apr 21 20:53:44 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:45 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d 1G" returned: 0 in 0.637s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:45 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d Apr 21 20:53:45 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d" returned: 0 in 0.686s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:46 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[85643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d Apr 21 20:53:46 devstack sudo[85643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:46 devstack sudo[85643]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d" returned: 0 in 0.718s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:46 devstack sudo[85647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info Apr 21 20:53:46 devstack sudo[85647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:47 devstack sudo[85647]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info" returned: 0 in 0.628s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:47 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:53:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:47 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info Apr 21 20:53:47 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:48 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.info" returned: 0 in 0.757s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.052s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:48 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-19a9f27c-2291-4f59-959d-9b7462c389d7 tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 2a6a00f6-95fe-4d5a-8d27-462fc6bdd91f: created successfully Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Flow 'volume_create_manager' (efc8222d-3427-435b-bbf6-aabd9881b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae01d5a-d73d-48e9-9150-a0158ad81c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae01d5a-d73d-48e9-9150-a0158ad81c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-409688574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b774a08-6c8d-4f07-afc5-4e0d85043f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5e62f2272414289eb88bf277272b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:49Z,use_quota=True,user_id='c287c885a2f24a9ab21011c0eed3bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a543db2-2c06-4a79-9f0c-79ee5974daa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a543db2-2c06-4a79-9f0c-79ee5974daa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eba0e4-9d87-4675-b8cd-d341b52f45ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eba0e4-9d87-4675-b8cd-d341b52f45ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b774a08-6c8d-4f07-afc5-4e0d85043f82', 'volume_name': 'volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6d1fb7-9aa3-49dd-bba9-953c64c39ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa6d1fb7-9aa3-49dd-bba9-953c64c39ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8175a68-6ce8-4580-b014-de7f86713f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:48 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82', 'volume_size': 1} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-409688574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b774a08-6c8d-4f07-afc5-4e0d85043f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d5e62f2272414289eb88bf277272b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:53:49Z,use_quota=True,user_id='c287c885a2f24a9ab21011c0eed3bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Creating volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:53:48 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:53:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:48 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 1073741824 Apr 21 20:53:48 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 1073741824" returned: 0 in 0.610s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 Apr 21 20:53:49 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:49 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 2a6a00f6-95fe-4d5a-8d27-462fc6bdd91f: deleting Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 2a6a00f6-95fe-4d5a-8d27-462fc6bdd91f: deleting {{(pid=81991) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-2c2c53b4-4989-43f2-a481-34b578d7ae9a" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-2c2c53b4-4989-43f2-a481-34b578d7ae9a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-e3eec031-ad81-432c-bdd7-bd3f9253968d" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-e3eec031-ad81-432c-bdd7-bd3f9253968d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Deleting offline snapshot e3eec031-ad81-432c-bdd7-bd3f9253968d of volume 2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] snapshot_file for this snap is: volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6785917c-8f03-46be-979f-fccabfa4bca6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:49 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d Apr 21 20:53:49 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82" returned: 0 in 0.856s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8175a68-6ce8-4580-b014-de7f86713f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15116baa-a731-4fa1-bea2-69df994cefc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:53:50 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Volume volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 (3b774a08-6c8d-4f07-afc5-4e0d85043f82): created successfully Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15116baa-a731-4fa1-bea2-69df994cefc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Flow 'volume_create_manager' (efc8222d-3427-435b-bbf6-aabd9881b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:53:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-20da52c4-37a3-42fa-bf66-3a28cef7903d tempest-VolumesSnapshotListTestJSON-16404486 None] Created volume successfully. Apr 21 20:53:50 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cb0f8e-1a8a-4e5f-a396-04244b8b33d5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a Apr 21 20:53:50 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=214,cinder:SELECT=164,cinder:INSERT=36,cinder:DELETE=11 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Creating offline snapshot f409838f-cd8b-4068-b107-0e74584597e6 of volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd2603-02b6-493b-b25b-b0f2f71eefbb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 Apr 21 20:53:50 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:50 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:50 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d Apr 21 20:53:50 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab02c029-50eb-4bd4-90cc-545987ba2ca7 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0" by "attach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab02c029-50eb-4bd4-90cc-545987ba2ca7 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0" acquired by "attach_volume" :: waited 0.035s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ab02c029-50eb-4bd4-90cc-545987ba2ca7 tempest-VolumesActionsTest-1598520617 None] Attaching volume 8bffc525-8862-46d7-896a-b5a9653d23a0 to instance 45606289-d53a-4057-8248-a08451d9af59 at mountpoint /dev/vdb on host None. Apr 21 20:53:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ab02c029-50eb-4bd4-90cc-545987ba2ca7 tempest-VolumesActionsTest-1598520617 None] Attach volume completed successfully. Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab02c029-50eb-4bd4-90cc-545987ba2ca7 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0" released by "attach_volume" :: held 0.126s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:51 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82" returned: 0 in 0.788s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 1G Apr 21 20:53:51 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d" returned: 0 in 0.757s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:51 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d Apr 21 20:53:51 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-81a9b0f1-29d5-4bc5-bc5f-68cb6faa18bd tempest-VolumesActionsTest-1598520617 None] Acquiring lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-detach_volume" by "detach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-81a9b0f1-29d5-4bc5-bc5f-68cb6faa18bd tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-81a9b0f1-29d5-4bc5-bc5f-68cb6faa18bd tempest-VolumesActionsTest-1598520617 None] Detaching volume 8bffc525-8862-46d7-896a-b5a9653d23a0 from instance 45606289-d53a-4057-8248-a08451d9af59. Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-81a9b0f1-29d5-4bc5-bc5f-68cb6faa18bd tempest-VolumesActionsTest-1598520617 None] Detach volume completed successfully. Apr 21 20:53:52 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:52 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-81a9b0f1-29d5-4bc5-bc5f-68cb6faa18bd tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:52 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 1G" returned: 0 in 0.546s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:53:52 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:52 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a.e3eec031-ad81-432c-bdd7-bd3f9253968d" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-e3eec031-ad81-432c-bdd7-bd3f9253968d" released by "_delete_snapshot" :: held 2.416s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-2c2c53b4-4989-43f2-a481-34b578d7ae9a" released by "delete_snapshot" :: held 2.447s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:52 devstack cinder-volume[81991]: WARNING cinder.quota [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-394910209 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-394910209, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:52 devstack cinder-volume[81991]: WARNING cinder.quota [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-394910209 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-394910209, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['321ae581-bb05-4b64-b3a1-391bcb9ce129', '56e1768c-cf99-4dec-940e-445773d567d1', '74ca74ca-04f1-4972-b1b1-403287d6aed8', 'bfd23701-9876-4124-b68f-53f1a3c9f719'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:52 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9ccdfd07-518f-490b-a0ec-f95df191214e tempest-GroupSnapshotsTest-1231936981 None] group_snapshot 2a6a00f6-95fe-4d5a-8d27-462fc6bdd91f: deleted successfully Apr 21 20:53:52 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.552s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:52 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 0.736s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:52 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 is being set with open permissions: ugo+rw Apr 21 20:53:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:52 devstack sudo[85777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:53:52 devstack sudo[85777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:53 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=193,cinder:SELECT=213,cinder:INSERT=59,cinder:DELETE=9 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:53:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "cinder-quobyte-2c2c53b4-4989-43f2-a481-34b578d7ae9a" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:53:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-2c2c53b4-4989-43f2-a481-34b578d7ae9a" acquired by "delete_volume" :: waited 0.025s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:53:53 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[088d238e-7282-435b-9266-13e287a38e36]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a Apr 21 20:53:54 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85777]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 1.526s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info Apr 21 20:53:54 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:54 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a" returned: 0 in 0.984s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:54 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a Apr 21 20:53:54 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:55 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info" returned: 0 in 0.786s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info is being set with open permissions: ugo+rw Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:55 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info Apr 21 20:53:55 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:55 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2c2c53b4-4989-43f2-a481-34b578d7ae9a" returned: 0 in 0.887s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Lock "cinder-quobyte-2c2c53b4-4989-43f2-a481-34b578d7ae9a" released by "delete_volume" :: held 1.990s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['ced4dcf0-9cf7-43af-b014-8da301360cb9'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:55 devstack cinder-volume[81991]: WARNING cinder.quota [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-394910209 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-394910209, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Created reservations ['5aee725a-ab22-4619-a65c-21f862ace1b6', 'fc05e925-de8b-4339-9bae-9002a1c21aef', 'a31a50d8-9df8-43e2-9c98-7d03aae78389', 'bfb2d2a8-0c7a-4bd1-b241-6b337d776882'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:55 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:53:55 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:56 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.info" returned: 0 in 0.988s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.460s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:53:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-edd6d7ee-48b6-4428-824b-fd249f4a509d tempest-VolumesSnapshotListTestJSON-16404486 None] Create snapshot completed successfully Apr 21 20:53:56 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.576s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:56 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:53:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a9c8f07c-dbf6-45b7-ae25-f9ff7bac8b1e tempest-GroupSnapshotsTest-1231936981 None] Delete group completed successfully. Apr 21 20:53:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:53:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:53:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Creating offline snapshot 42ae65df-9c9a-4a3f-96eb-c1f56048da7c of volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:53:57 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[324dfed7-9d7c-49f8-8c16-e481258a3747]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:53:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:57 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:53:57 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:58 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 0.883s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:53:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:58 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c 1G Apr 21 20:53:58 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:53:59 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 21 20:53:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c 1G" returned: 0 in 0.946s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:53:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:53:59 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:53:59 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:00 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 0.790s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:00 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c is being set with open permissions: ugo+rw Apr 21 20:54:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:00 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:54:00 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:01 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 0.905s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.707s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:01 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-726bd6f2-2c3d-4941-83f0-5fc1142b1904 tempest-VolumesSnapshotListTestJSON-16404486 None] Create snapshot completed successfully Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Creating offline snapshot ac615627-55c8-4624-bd67-5ad6818fc107 of volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4999b8-7fcb-47be-828e-cd83d253c024]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:01 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:54:01 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:02 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 0.673s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:02 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 1G Apr 21 20:54:02 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:03 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 1G" returned: 0 in 0.703s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 Apr 21 20:54:03 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:03 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107" returned: 0 in 0.629s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:03 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 is being set with open permissions: ugo+rw Apr 21 20:54:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:03 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 Apr 21 20:54:03 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:04 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3c0a7174-7f5b-4749-9412-bd46a45393ea tempest-GroupsV320Test-306886704 None] Group tempest-GroupsV320Test-Group-167529590: creating Apr 21 20:54:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fcc6c550-a6ca-4daa-b3a2-57fda731e014 tempest-VolumesSnapshotListTestJSON-16404486 None] Create snapshot completed successfully Apr 21 20:54:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3c0a7174-7f5b-4749-9412-bd46a45393ea tempest-GroupsV320Test-306886704 None] Group tempest-GroupsV320Test-Group-167529590: created successfully Apr 21 20:54:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3c0a7174-7f5b-4749-9412-bd46a45393ea tempest-GroupsV320Test-306886704 None] Create group completed successfully. Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-ac615627-55c8-4624-bd67-5ad6818fc107-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-ac615627-55c8-4624-bd67-5ad6818fc107-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-ac615627-55c8-4624-bd67-5ad6818fc107" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-ac615627-55c8-4624-bd67-5ad6818fc107" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Deleting offline snapshot ac615627-55c8-4624-bd67-5ad6818fc107 of volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] snapshot_file for this snap is: volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9df165-2d0d-443d-89c4-cb8e1f2474ef]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:05 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 Apr 21 20:54:05 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Created reservations ['5e477f2a-fab3-4c46-8f26-d387ccc17391'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:06 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:06 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:06 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.676s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:06 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:06 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-83a232a2-077a-4b55-a758-bc9b6afcb477 tempest-GroupsV320Test-306886704 None] Delete group completed successfully. Apr 21 20:54:07 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107" returned: 0 in 1.384s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e71876-6e4a-4cc7-a1b2-6cb2c3254596]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:07 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:54:07 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:08 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 1.227s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:08 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 Apr 21 20:54:08 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Flow 'volume_create_manager' (021205de-70c7-4f1b-a62d-575ee676871b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a28c25-b4a6-41d1-8447-fdeee6b9b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:09 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a28c25-b4a6-41d1-8447-fdeee6b9b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1414562912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730fa397ebcb41708e4ac40a8da491dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:09Z,use_quota=True,user_id='e2cbacd5ad54462fa1f1de763bfb58ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a609da60-0e6a-4899-971b-f9286c560395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a609da60-0e6a-4899-971b-f9286c560395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995489f2-2cf3-4e8a-86ab-7f650cc3a298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995489f2-2cf3-4e8a-86ab-7f650cc3a298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb', 'volume_name': 'volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fb39d4-1152-42a5-9cc3-2d158ea60723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fb39d4-1152-42a5-9cc3-2d158ea60723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3cece-9cd3-4be6-a317-ba7c6e6d32e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:09 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Volume 3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb', 'volume_size': 1} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1414562912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730fa397ebcb41708e4ac40a8da491dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:09Z,use_quota=True,user_id='e2cbacd5ad54462fa1f1de763bfb58ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Creating volume 3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:09 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107" returned: 0 in 0.919s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:09 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb 1073741824 Apr 21 20:54:09 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:09 devstack sudo[86011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107 Apr 21 20:54:09 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:10 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.ac615627-55c8-4624-bd67-5ad6818fc107" returned: 0 in 1.149s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-ac615627-55c8-4624-bd67-5ad6818fc107" released by "_delete_snapshot" :: held 4.810s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" released by "delete_snapshot" :: held 4.833s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Created reservations ['4af22749-47a5-4042-ad0c-fbbf1ab01fcc', '12777464-f701-49ee-b6fe-b813f3f75a92', '9ea8e3b5-967d-4cee-988c-5bd9203430dc', '4d611e9e-b480-416f-bc4e-3051b1fdd174'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Delete snapshot completed successfully. Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8a7c7da0-0fc9-4cba-af0e-e129dc42b2f8 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-ac615627-55c8-4624-bd67-5ad6818fc107-delete_snapshot" released by "delete_snapshot" :: held 4.971s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:10 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb 1073741824" returned: 0 in 1.383s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:10 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb Apr 21 20:54:10 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-42ae65df-9c9a-4a3f-96eb-c1f56048da7c-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-42ae65df-9c9a-4a3f-96eb-c1f56048da7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-42ae65df-9c9a-4a3f-96eb-c1f56048da7c" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-42ae65df-9c9a-4a3f-96eb-c1f56048da7c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Deleting offline snapshot 42ae65df-9c9a-4a3f-96eb-c1f56048da7c of volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] snapshot_file for this snap is: volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1013e40-816c-4850-8bf4-c30d9b744c81]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:11 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:54:11 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:11 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb" returned: 0 in 0.983s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c3cece-9cd3-4be6-a317-ba7c6e6d32e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3c4c84-8b8f-4050-b55f-40ba6232f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:11 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Volume volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb (3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb): created successfully Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3c4c84-8b8f-4050-b55f-40ba6232f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Flow 'volume_create_manager' (021205de-70c7-4f1b-a62d-575ee676871b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-cac0ce02-88e0-4bc4-86f8-ba4ea2d343ea tempest-ServerRescueNegativeTestJSON-107121121 None] Created volume successfully. Apr 21 20:54:11 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 0.846s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1709a255-c7ad-4a78-b48e-c4b1eda47886]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:12 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:54:12 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:12 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 1.007s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:13 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:54:13 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 1.342s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:14 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c Apr 21 20:54:14 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:14 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.42ae65df-9c9a-4a3f-96eb-c1f56048da7c" returned: 0 in 0.616s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-42ae65df-9c9a-4a3f-96eb-c1f56048da7c" released by "_delete_snapshot" :: held 3.891s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" released by "delete_snapshot" :: held 3.925s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Created reservations ['08808895-87ac-4951-9228-dbaad47def5b', '19d5e69c-5912-4361-b92d-bda2d5a58cb3', '58a0d222-2eed-479f-9b3c-2a99d50d72ed', '77196252-6f08-4371-a56c-af7309503767'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Delete snapshot completed successfully. Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b0d565-a4fa-4444-a909-a34845ccc918 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-42ae65df-9c9a-4a3f-96eb-c1f56048da7c-delete_snapshot" released by "delete_snapshot" :: held 4.150s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-f409838f-cd8b-4068-b107-0e74584597e6-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-f409838f-cd8b-4068-b107-0e74584597e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-f409838f-cd8b-4068-b107-0e74584597e6" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-f409838f-cd8b-4068-b107-0e74584597e6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Deleting offline snapshot f409838f-cd8b-4068-b107-0e74584597e6 of volume 3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] snapshot_file for this snap is: volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8158dd45-e161-4bea-8a05-bc2beb30fa2c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:15 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:54:15 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3134176a-333a-4353-b48a-bbe5a6fd86b4 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0" by "attach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3134176a-333a-4353-b48a-bbe5a6fd86b4 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0" acquired by "attach_volume" :: waited 0.021s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3134176a-333a-4353-b48a-bbe5a6fd86b4 tempest-VolumesActionsTest-1598520617 None] Attaching volume 8bffc525-8862-46d7-896a-b5a9653d23a0 to instance 6f18234e-0995-462a-81d5-ff6c6b64ce1a at mountpoint /dev/vdb on host None. Apr 21 20:54:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3134176a-333a-4353-b48a-bbe5a6fd86b4 tempest-VolumesActionsTest-1598520617 None] Attach volume completed successfully. Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3134176a-333a-4353-b48a-bbe5a6fd86b4 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0" released by "attach_volume" :: held 0.090s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:16 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 0.694s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc4d478-553b-4c01-8f91-f1b819b604a6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:16 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 Apr 21 20:54:16 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43082e6b-50dd-4cb3-bcdc-53873b7cb803 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-detach_volume" by "detach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43082e6b-50dd-4cb3-bcdc-53873b7cb803 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-43082e6b-50dd-4cb3-bcdc-53873b7cb803 tempest-VolumesActionsTest-1598520617 None] Detaching volume 8bffc525-8862-46d7-896a-b5a9653d23a0 from instance 6f18234e-0995-462a-81d5-ff6c6b64ce1a. Apr 21 20:54:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-43082e6b-50dd-4cb3-bcdc-53873b7cb803 tempest-VolumesActionsTest-1598520617 None] Detach volume completed successfully. Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43082e6b-50dd-4cb3-bcdc-53873b7cb803 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:16 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82" returned: 0 in 0.783s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:16 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:54:16 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:17 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 0.996s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:17 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6 Apr 21 20:54:17 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:18 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82.f409838f-cd8b-4068-b107-0e74584597e6" returned: 0 in 0.587s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-f409838f-cd8b-4068-b107-0e74584597e6" released by "_delete_snapshot" :: held 3.207s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" released by "delete_snapshot" :: held 3.227s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:18 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Created reservations ['1b22e6a1-545d-4ff8-a28d-a0485ff3086e', 'bc80fa14-a783-4032-a623-de966da6b614', '3b7045c9-521c-41c8-ba83-7eb4d7b35d69', '9c5868ca-a3d0-4b17-972f-918ec87d21a9'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Delete snapshot completed successfully. Apr 21 20:54:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-13f948ce-3975-4526-b8fc-9ce35197e88b tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-f409838f-cd8b-4068-b107-0e74584597e6-delete_snapshot" released by "delete_snapshot" :: held 3.422s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-3b774a08-6c8d-4f07-afc5-4e0d85043f82-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-3b774a08-6c8d-4f07-afc5-4e0d85043f82-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b95be-7a4d-4a12-8bc1-2284c1e51e0f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:19 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 Apr 21 20:54:19 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82" returned: 0 in 0.721s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:20 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82 Apr 21 20:54:20 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:20 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b774a08-6c8d-4f07-afc5-4e0d85043f82" returned: 0 in 0.462s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-quobyte-3b774a08-6c8d-4f07-afc5-4e0d85043f82" released by "delete_volume" :: held 1.230s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:20 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Created reservations ['486491ea-1ba5-494b-b07f-ff9b121e8e37', 'f6a5ee67-8a4d-43c2-b47f-3a67e58b7c66', '7b17c0f8-b527-4e77-9fc9-e14564fe30cd', '9bbfb62b-3aa7-4233-8f02-03ea53c5a5b8'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:21 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:21 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:21 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.527s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:21 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Deleted volume successfully. Apr 21 20:54:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2769f177-f235-4cda-90fd-96c73727f635 tempest-VolumesSnapshotListTestJSON-16404486 None] Lock "cinder-3b774a08-6c8d-4f07-afc5-4e0d85043f82-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (c5fd4c72-14fc-4205-b6bd-d56f529d2111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae93bee-2b4b-4799-b359-3752ac63ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae93bee-2b4b-4799-b359-3752ac63ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433569281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45259b2a-6cee-420d-90a1-cf190ee663de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:25Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d73165-3181-4046-aa06-87983218b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d73165-3181-4046-aa06-87983218b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bb34eb-8134-41b1-8f93-d26e68744f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bb34eb-8134-41b1-8f93-d26e68744f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45259b2a-6cee-420d-90a1-cf190ee663de', 'volume_name': 'volume-45259b2a-6cee-420d-90a1-cf190ee663de', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9e2b8-c222-4f97-880f-d5043e85e941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9e2b8-c222-4f97-880f-d5043e85e941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d553f1ef-e430-40aa-9ee3-d409e184b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:24 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume 45259b2a-6cee-420d-90a1-cf190ee663de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45259b2a-6cee-420d-90a1-cf190ee663de', 'volume_size': 1} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-433569281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45259b2a-6cee-420d-90a1-cf190ee663de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:25Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Creating volume 45259b2a-6cee-420d-90a1-cf190ee663de {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:24 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:24 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de 1073741824 Apr 21 20:54:24 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de 1073741824" returned: 0 in 1.184s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:26 devstack sudo[86242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de Apr 21 20:54:26 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:26 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de" returned: 0 in 0.737s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d553f1ef-e430-40aa-9ee3-d409e184b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45259b2a-6cee-420d-90a1-cf190ee663de', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34398d0-b225-40de-80b7-86384ebeb394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:26 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume volume-45259b2a-6cee-420d-90a1-cf190ee663de (45259b2a-6cee-420d-90a1-cf190ee663de): created successfully Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34398d0-b225-40de-80b7-86384ebeb394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (c5fd4c72-14fc-4205-b6bd-d56f529d2111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8753bbf9-1912-4314-b37e-897c495569fc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created volume successfully. Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eefac7-2fe1-483e-996d-770bd580ac89]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:27 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:27 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Flow 'volume_create_manager' (86a8db54-bd09-4103-b9c5-66157f8cd98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d345af-aa90-442d-950d-35499759f1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d345af-aa90-442d-950d-35499759f1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-67850695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa2186c-ecf2-4def-b238-b9012796d5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8ff8c3140d477ea7a22e28f836a1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:27Z,use_quota=True,user_id='de459941617749e6846c8b05c7645691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65e98c9-40fb-4105-84b7-e9319c93dd09),volume_type_id=b65e98c9-40fb-4105-84b7-e9319c93dd09)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073cec2a-3655-4ed1-99f3-ef4a22853fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073cec2a-3655-4ed1-99f3-ef4a22853fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63065d8-8489-4fbb-9f83-a639a57524d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63065d8-8489-4fbb-9f83-a639a57524d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa2186c-ecf2-4def-b238-b9012796d5c3', 'volume_name': 'volume-3aa2186c-ecf2-4def-b238-b9012796d5c3', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d211d4-1215-402f-9034-f4c9f303f078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d211d4-1215-402f-9034-f4c9f303f078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3e489f-899a-4ed2-9dd7-1d5cfd459bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Volume 3aa2186c-ecf2-4def-b238-b9012796d5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa2186c-ecf2-4def-b238-b9012796d5c3', 'volume_size': 1} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (52a4476f-4b7a-47e6-9866-99ccdcca0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513a35e3-5b05-4848-a101-bb2903e001ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513a35e3-5b05-4848-a101-bb2903e001ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154993382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d461a8-2949-43d3-be3c-12f1b2699fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad9131d-6788-4e73-a102-72970584a950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad9131d-6788-4e73-a102-72970584a950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6100d57-530e-44fe-9c9e-eee7ebe5c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6100d57-530e-44fe-9c9e-eee7ebe5c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3d461a8-2949-43d3-be3c-12f1b2699fbd', 'volume_name': 'volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8e630e-de1d-445b-b1ab-99c855538878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8e630e-de1d-445b-b1ab-99c855538878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3972019f-073b-424c-9eac-f1cc84e4c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:27 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume b3d461a8-2949-43d3-be3c-12f1b2699fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd', 'volume_size': 1} Apr 21 20:54:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:28 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (f9468eb9-7abd-4e0e-a691-8357582e83bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a8088e-3ab3-4fb2-98f8-eed80b2f5cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.958s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a8088e-3ab3-4fb2-98f8-eed80b2f5cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019506920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c4544-fb80-49de-b7e6-e6ae4553730e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ecaedc-8a39-425d-ae1b-48359fde55a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ecaedc-8a39-425d-ae1b-48359fde55a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02df3bc0-6da8-43f7-a2f3-85d1b5108360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02df3bc0-6da8-43f7-a2f3-85d1b5108360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8c4544-fb80-49de-b7e6-e6ae4553730e', 'volume_name': 'volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571d8538-cd8d-44f8-96ea-7222b55e2673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571d8538-cd8d-44f8-96ea-7222b55e2673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e4f561-89df-4c89-bcba-e755fccd2d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume 3f8c4544-fb80-49de-b7e6-e6ae4553730e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e', 'volume_size': 1} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[23974c8d-eb5d-4954-8996-75282993aacf]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (eee0716e-5c71-4072-b509-69292ac31c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3340bd0b-f508-40c8-91a9-e6e2d2fb16e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:28 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3340bd0b-f508-40c8-91a9-e6e2d2fb16e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835590821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e115982-e8a2-445e-873e-d6e6abeab320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e139edc-607a-45cf-8b9d-193f523531d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e139edc-607a-45cf-8b9d-193f523531d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f36c351-f115-4330-936e-68df4c6192a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f36c351-f115-4330-936e-68df4c6192a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e115982-e8a2-445e-873e-d6e6abeab320', 'volume_name': 'volume-8e115982-e8a2-445e-873e-d6e6abeab320', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0342b8b-b0bc-42e8-93f9-5fee491e7d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0342b8b-b0bc-42e8-93f9-5fee491e7d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a3d3b9-8346-4080-bd51-4f67cd30c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:28 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume 8e115982-e8a2-445e-873e-d6e6abeab320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e115982-e8a2-445e-873e-d6e6abeab320', 'volume_size': 1} Apr 21 20:54:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (f8d99b1a-3fb2-459f-8934-531bdacfb301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3d4799-2292-4076-b64c-8557bcbc630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3d4799-2292-4076-b64c-8557bcbc630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89402382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8738b3fd-3bd8-4739-b7e7-8248973ee6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:29Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fda935-549e-4d81-9cb2-ad4c6ccc2317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fda935-549e-4d81-9cb2-ad4c6ccc2317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a44c0f-5fab-49c4-b3a9-d210dfdb11b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a44c0f-5fab-49c4-b3a9-d210dfdb11b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8738b3fd-3bd8-4739-b7e7-8248973ee6f4', 'volume_name': 'volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454286e3-5ea8-4207-8efe-14bdb7b5bb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454286e3-5ea8-4207-8efe-14bdb7b5bb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a00b181-b536-4eac-8c7d-625e57bc1549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume 8738b3fd-3bd8-4739-b7e7-8248973ee6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4', 'volume_size': 1} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:29 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 1.200s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.fe92a8b3-c97f-4b01-8e0f-8ce71dc77ee84k8azyb7.img {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:29 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.fe92a8b3-c97f-4b01-8e0f-8ce71dc77ee84k8azyb7.img Apr 21 20:54:29 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (bbb2481d-76ad-4447-918c-8915a534ef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1685e7c1-6793-40b8-b773-02402d05b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1685e7c1-6793-40b8-b773-02402d05b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909134882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d154f6-8261-4ca3-b0cf-4a07ae561a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:29Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ad5bc6-98f2-4109-a758-212aed6cc8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ad5bc6-98f2-4109-a758-212aed6cc8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e252802-0d30-44ad-be2e-d95f87f045ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e252802-0d30-44ad-be2e-d95f87f045ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d154f6-8261-4ca3-b0cf-4a07ae561a4f', 'volume_name': 'volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e0970c-6dff-4f70-a7ae-bbc095b7b51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e0970c-6dff-4f70-a7ae-bbc095b7b51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb830ed0-2447-4071-9f59-022fc5240244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:29 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume b1d154f6-8261-4ca3-b0cf-4a07ae561a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f', 'volume_size': 1} Apr 21 20:54:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Acquiring lock "cinder-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "cinder-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Acquiring lock "cinder-quobyte-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "cinder-quobyte-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb" acquired by "delete_volume" :: waited 0.030s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[265a649a-ad9b-4703-bdda-db6b2cb7f705]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:31 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb Apr 21 20:54:31 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:32 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.fe92a8b3-c97f-4b01-8e0f-8ce71dc77ee84k8azyb7.img" returned: 0 in 2.978s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:32 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[692902da-edfc-4c9a-a168-c06b7538356c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:32 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:32 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:32 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb" returned: 0 in 1.182s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:32 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb Apr 21 20:54:32 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:33 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.695s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0, size 1024.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.fe92a8b3-c97f-4b01-8e0f-8ce71dc77ee84k8azyb7.img {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:33 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Converted 1024.00 MB image at 343.62 MB/s Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] fe92a8b3-c97f-4b01-8e0f-8ce71dc77ee8 was raw, no need to convert to raw {{(pid=81991) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 21 20:54:33 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "cinder-quobyte-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb" released by "delete_volume" :: held 1.748s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Created reservations ['c31989b4-1df9-4176-87e2-f3e30ec15ea8', '59622663-c966-475c-a986-e55e4eeb68e6', '1cdc517a-f87a-473c-bffd-4ff303b35168', '61775505-64b8-4012-b318-07356a04e4c8'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:33 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:33 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:33 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.664s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:33 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Deleted volume successfully. Apr 21 20:54:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f22dd5bf-45d2-4143-8570-4ea8a67289da tempest-ServerRescueNegativeTestJSON-107121121 None] Lock "cinder-3bcb1259-ffc5-41e3-beb1-9d3fdd7333cb-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=75,cinder:UPDATE=79,cinder:INSERT=14,cinder:DELETE=1 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.381s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Uploaded volume to glance image-id: fe92a8b3-c97f-4b01-8e0f-8ce71dc77ee8. {{(pid=81991) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.121s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-67850695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa2186c-ecf2-4def-b238-b9012796d5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8ff8c3140d477ea7a22e28f836a1f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:27Z,use_quota=True,user_id='de459941617749e6846c8b05c7645691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65e98c9-40fb-4105-84b7-e9319c93dd09),volume_type_id=b65e98c9-40fb-4105-84b7-e9319c93dd09)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Creating volume 3aa2186c-ecf2-4def-b238-b9012796d5c3 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:43 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:43 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 1073741824 Apr 21 20:54:43 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5384356a-a66c-4072-81f0-1173117be9ad tempest-VolumesActionsTest-1598520617 None] Copy volume to image completed successfully. Apr 21 20:54:43 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 1073741824" returned: 0 in 0.512s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 Apr 21 20:54:44 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:44 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.715s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1154993382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d461a8-2949-43d3-be3c-12f1b2699fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Creating volume b3d461a8-2949-43d3-be3c-12f1b2699fbd {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:44 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3e489f-899a-4ed2-9dd7-1d5cfd459bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa2186c-ecf2-4def-b238-b9012796d5c3', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5230b3-6271-4938-9316-46c32412bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:44 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd 1073741824 Apr 21 20:54:44 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Volume volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 (3aa2186c-ecf2-4def-b238-b9012796d5c3): created successfully Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5230b3-6271-4938-9316-46c32412bc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Flow 'volume_create_manager' (86a8db54-bd09-4103-b9c5-66157f8cd98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9a9b2378-0d8d-4b57-ab9d-a3ae919d89e2 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Created volume successfully. Apr 21 20:54:45 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd 1073741824" returned: 0 in 0.552s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd Apr 21 20:54:45 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd" returned: 0 in 0.399s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.355s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1019506920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8c4544-fb80-49de-b7e6-e6ae4553730e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Creating volume 3f8c4544-fb80-49de-b7e6-e6ae4553730e {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:45 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3972019f-073b-424c-9eac-f1cc84e4c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ad32d8-00f1-40d5-b153-4b086a39acd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:45 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e 1073741824 Apr 21 20:54:45 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd (b3d461a8-2949-43d3-be3c-12f1b2699fbd): created successfully Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24ad32d8-00f1-40d5-b153-4b086a39acd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (52a4476f-4b7a-47e6-9866-99ccdcca0950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-256b1b4e-bb34-4036-915f-22b70885f19b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created volume successfully. Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:45 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:45 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e 1073741824" returned: 0 in 0.595s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e Apr 21 20:54:46 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.493s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:46 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fbdf8ea1-28b3-4ad9-9f5e-55feb2445ce7 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Retype volume completed successfully. Apr 21 20:54:46 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e" returned: 0 in 0.440s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.201s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835590821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e115982-e8a2-445e-873e-d6e6abeab320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:28Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Creating volume 8e115982-e8a2-445e-873e-d6e6abeab320 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:46 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:46 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 1073741824 Apr 21 20:54:46 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e4f561-89df-4c89-bcba-e755fccd2d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859575c7-512b-4903-87c5-c24ca4914fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:46 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e (3f8c4544-fb80-49de-b7e6-e6ae4553730e): created successfully Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859575c7-512b-4903-87c5-c24ca4914fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (f9468eb9-7abd-4e0e-a691-8357582e83bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:46 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-15225336-65d4-4a44-9829-8d147952eb25 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created volume successfully. Apr 21 20:54:47 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 1073741824" returned: 0 in 0.569s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Acquiring lock "cinder-3aa2186c-ecf2-4def-b238-b9012796d5c3-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "cinder-3aa2186c-ecf2-4def-b238-b9012796d5c3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 Apr 21 20:54:47 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Acquiring lock "cinder-quobyte-3aa2186c-ecf2-4def-b238-b9012796d5c3" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "cinder-quobyte-3aa2186c-ecf2-4def-b238-b9012796d5c3" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c37fc2a-5e67-4329-a52d-e2db8213fdce]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 Apr 21 20:54:47 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320" returned: 0 in 0.527s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.395s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-89402382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8738b3fd-3bd8-4739-b7e7-8248973ee6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:29Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Creating volume 8738b3fd-3bd8-4739-b7e7-8248973ee6f4 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:47 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a3d3b9-8346-4080-bd51-4f67cd30c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e115982-e8a2-445e-873e-d6e6abeab320', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c12fe7-8a64-4d63-a8a4-0549cb742a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:47 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 1073741824 Apr 21 20:54:47 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume volume-8e115982-e8a2-445e-873e-d6e6abeab320 (8e115982-e8a2-445e-873e-d6e6abeab320): created successfully Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c12fe7-8a64-4d63-a8a4-0549cb742a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (eee0716e-5c71-4072-b509-69292ac31c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:47 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ba798924-19c7-4720-88f2-5c4e0b5ec6f2 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created volume successfully. Apr 21 20:54:47 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3" returned: 0 in 0.545s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:47 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3 Apr 21 20:54:47 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:48 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3aa2186c-ecf2-4def-b238-b9012796d5c3" returned: 0 in 0.522s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "cinder-quobyte-3aa2186c-ecf2-4def-b238-b9012796d5c3" released by "delete_volume" :: held 1.110s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:48 devstack cinder-volume[81991]: WARNING cinder.quota [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:48 devstack cinder-volume[81991]: WARNING cinder.quota [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:54:48 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 1073741824" returned: 0 in 0.655s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Created reservations ['161bf906-334a-415d-8089-db5135f5d424', 'd4200ea0-74a6-43b4-8de0-3a8204467208', '7fda1297-2cd8-4ec2-a078-a3b872d6d438', 'fd0614c3-99f2-4c43-81ce-181647ba7945'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:48 devstack sudo[86468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 Apr 21 20:54:48 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:49 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4" returned: 0 in 0.513s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.909s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-909134882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d154f6-8261-4ca3-b0cf-4a07ae561a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac8c7038ab40bc8494dd1d67df78d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:29Z,use_quota=True,user_id='0ee6b1b2cb354234bc7f6f1f3731e545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Creating volume b1d154f6-8261-4ca3-b0cf-4a07ae561a4f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:49 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a00b181-b536-4eac-8c7d-625e57bc1549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a9076b-30b5-46c0-af6d-19d87bef5333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:49 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f 1073741824 Apr 21 20:54:49 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:49 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 (8738b3fd-3bd8-4739-b7e7-8248973ee6f4): created successfully Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a9076b-30b5-46c0-af6d-19d87bef5333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (f8d99b1a-3fb2-459f-8934-531bdacfb301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:49 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-57b94d93-bd29-40e5-bc97-cfc98f64523a tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created volume successfully. Apr 21 20:54:49 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.685s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:49 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Deleted volume successfully. Apr 21 20:54:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8303e4b7-0978-45b3-a03b-ac888fdafc40 tempest-VolumeRetypeWithoutMigrationTest-2030474397 None] Lock "cinder-3aa2186c-ecf2-4def-b238-b9012796d5c3-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:50 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f 1073741824" returned: 0 in 0.699s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f Apr 21 20:54:50 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:50 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f" returned: 0 in 0.540s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.480s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb830ed0-2447-4071-9f59-022fc5240244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad3c28d-53e7-49a5-a60c-cb7bbbf8783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f45a249-dac0-4a75-9964-4f0bc74fc41b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:50 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Volume volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f (b1d154f6-8261-4ca3-b0cf-4a07ae561a4f): created successfully Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad3c28d-53e7-49a5-a60c-cb7bbbf8783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Flow 'volume_create_manager' (bbb2481d-76ad-4447-918c-8915a534ef53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-cb79e771-d8d5-4b65-b8ed-29cfc84914f9 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created volume successfully. Apr 21 20:54:50 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:50 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-quobyte-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2286dd4-446a-418b-bff1-57990695d83a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f Apr 21 20:54:51 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.626s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d00277-394f-436f-9185-3a4337c38d9e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:51 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Flow 'volume_create_manager' (97280016-5172-490a-9498-1b9e7b5ec090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e9716-4d39-443a-97d4-5378d4de39a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9e9716-4d39-443a-97d4-5378d4de39a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-36714010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c912308b-d8c4-4128-a0af-3905daa6387d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4dd80c6a82495d9a6b8bc6977cdc94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='9e09f54220954c86953cebb5ff0169de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f8b6c2-a785-4db7-94c8-a043461e5776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f8b6c2-a785-4db7-94c8-a043461e5776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3a0141-b434-47ff-9ef2-3e10bbd1970b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3a0141-b434-47ff-9ef2-3e10bbd1970b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c912308b-d8c4-4128-a0af-3905daa6387d', 'volume_name': 'volume-c912308b-d8c4-4128-a0af-3905daa6387d', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419ec31e-a82a-4ed6-ac50-01687c7d4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419ec31e-a82a-4ed6-ac50-01687c7d4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f87e0e-948c-4882-9b22-22054b3bae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:51 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Volume c912308b-d8c4-4128-a0af-3905daa6387d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c912308b-d8c4-4128-a0af-3905daa6387d', 'volume_size': 1} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:51 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f" returned: 0 in 0.773s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f Apr 21 20:54:51 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:51 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:51 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.692s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:52 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img Apr 21 20:54:52 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:52 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.512s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:52 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f" returned: 0 in 0.606s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f" released by "delete_volume" :: held 1.408s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created reservations ['1dce2e53-cb02-4ca1-9215-cddd6e231d94', 'e33cc6c2-d14e-4f49-94e0-a5e89ab4a52b', 'ef79a32a-8044-4901-a64a-dd1a2b92aad5', '56fdefea-7f8a-4b50-932c-cb94ced5a75d'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:53 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:53 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-8738b3fd-3bd8-4739-b7e7-8248973ee6f4-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-8738b3fd-3bd8-4739-b7e7-8248973ee6f4-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-quobyte-8738b3fd-3bd8-4739-b7e7-8248973ee6f4" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-8738b3fd-3bd8-4739-b7e7-8248973ee6f4" acquired by "delete_volume" :: waited 0.044s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:53 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3013935-b541-48a4-bc2d-b40a4cb24b9d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 Apr 21 20:54:54 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img" returned: 0 in 2.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5be31c-2592-45de-9887-b90d7cb6c714]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 1.678s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:54 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Deleted volume successfully. Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=93,cinder:INSERT=28,cinder:UPDATE=97,cinder:DELETE=10 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9b490ae3-557b-48bb-90b7-dc8a87c24d19 tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-b1d154f6-8261-4ca3-b0cf-4a07ae561a4f-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:54 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:54 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:54 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4" returned: 0 in 1.020s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:54 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4 Apr 21 20:54:54 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8738b3fd-3bd8-4739-b7e7-8248973ee6f4" returned: 0 in 0.395s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-8738b3fd-3bd8-4739-b7e7-8248973ee6f4" released by "delete_volume" :: held 1.499s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:55 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created reservations ['366c40eb-29d3-4c0f-a69c-e59941c6288e', '4824f1ac-ce42-4063-8325-e8e9b8c59185', '5fe1a8a2-873f-436b-8c33-c560e0c70b7c', '26bbc821-c801-44b5-9659-d7ddaf5cc21d'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.676s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:55 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Converted 1024.00 MB image at 414.21 MB/s Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] 7ec6a0c0-3ed4-4e00-a2c8-320cf771f330 was raw, converting to qcow2 {{(pid=81991) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a452bfd-a958-4d1c-8399-05fbe1ed2120]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:55 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img Apr 21 20:54:55 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-8e115982-e8a2-445e-873e-d6e6abeab320-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-8e115982-e8a2-445e-873e-d6e6abeab320-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:55 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img" returned: 0 in 0.531s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-quobyte-8e115982-e8a2-445e-873e-d6e6abeab320" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.542s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Deleted volume successfully. Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-8e115982-e8a2-445e-873e-d6e6abeab320" acquired by "delete_volume" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fe61fe11-6e07-49bd-ba44-d102adc69d9b tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-8738b3fd-3bd8-4739-b7e7-8248973ee6f4-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe4494-796d-4314-8a7e-726aff67dd84]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:55 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img Apr 21 20:54:55 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:55 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 Apr 21 20:54:55 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img" returned: 1 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh Apr 21 20:54:56 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320" returned: 0 in 0.536s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320 Apr 21 20:54:56 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh" returned: 0 in 0.493s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Image conversion details: src /opt/stack/data/cinder/conversion/8bffc525-8862-46d7-896a-b5a9653d23a0.temp_image.7ec6a0c0-3ed4-4e00-a2c8-320cf771f33059go82sw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:54:56 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf5debe-37be-4a6a-99ab-692456104977]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8e115982-e8a2-445e-873e-d6e6abeab320" returned: 0 in 0.467s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:56 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh Apr 21 20:54:56 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-8e115982-e8a2-445e-873e-d6e6abeab320" released by "delete_volume" :: held 1.027s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created reservations ['9cea9184-3706-48ce-8319-e5ce82212205', '2f160c09-d884-434a-b593-540082b07fb8', 'e8d89aa6-4af8-4485-95f6-17ef4809083a', '7a1543ca-a512-4cff-8034-4c370003745f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:56 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:56 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:57 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f3mdvaqh" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Deleted volume successfully. Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3923e682-a60e-4e37-979c-232f483385ff tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-8e115982-e8a2-445e-873e-d6e6abeab320-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-3f8c4544-fb80-49de-b7e6-e6ae4553730e-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-3f8c4544-fb80-49de-b7e6-e6ae4553730e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-quobyte-3f8c4544-fb80-49de-b7e6-e6ae4553730e" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-3f8c4544-fb80-49de-b7e6-e6ae4553730e" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[263a73f5-b321-4600-82fd-9418b36ff6ca]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e Apr 21 20:54:58 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.569s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Uploaded volume to glance image-id: 7ec6a0c0-3ed4-4e00-a2c8-320cf771f330. {{(pid=81991) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.446s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-36714010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c912308b-d8c4-4128-a0af-3905daa6387d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4dd80c6a82495d9a6b8bc6977cdc94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:52Z,use_quota=True,user_id='9e09f54220954c86953cebb5ff0169de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Creating volume c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:58 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3e1e7ad3-262b-496d-9569-824c96082ad8 tempest-VolumesActionsTest-1598520617 None] Copy volume to image completed successfully. Apr 21 20:54:58 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d 1073741824 Apr 21 20:54:58 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e" returned: 0 in 0.654s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e Apr 21 20:54:58 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Flow 'volume_create_manager' (ed44afd3-586b-456c-9e1b-17d1b64940fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d815f04d-e37c-4046-9d38-c2e19ebb9f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d815f04d-e37c-4046-9d38-c2e19ebb9f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1371796125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c554c483-f0fa-4898-ab31-459ff22e243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c299c5ccac04991be5ad8ac6691cc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:59Z,use_quota=True,user_id='833e6e12d89b42c08984a68192be4029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c8e7b9f-82fe-4c12-91af-e08d9f39a2eb),volume_type_id=4c8e7b9f-82fe-4c12-91af-e08d9f39a2eb)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a377352e-fb5e-4fab-8443-fae550b041eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a377352e-fb5e-4fab-8443-fae550b041eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8141e4-53ff-4eff-a65d-908eeae1a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8141e4-53ff-4eff-a65d-908eeae1a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c554c483-f0fa-4898-ab31-459ff22e243b', 'volume_name': 'volume-c554c483-f0fa-4898-ab31-459ff22e243b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0154291f-138e-457b-aa2f-e8ca862a4826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0154291f-138e-457b-aa2f-e8ca862a4826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c869cf-6112-4ace-b12a-a86d1e88f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:58 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Volume c554c483-f0fa-4898-ab31-459ff22e243b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c554c483-f0fa-4898-ab31-459ff22e243b', 'volume_size': 1} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:58 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d 1073741824" returned: 0 in 0.591s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:58 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d Apr 21 20:54:58 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:59 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3f8c4544-fb80-49de-b7e6-e6ae4553730e" returned: 0 in 0.531s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-3f8c4544-fb80-49de-b7e6-e6ae4553730e" released by "delete_volume" :: held 1.212s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "cinder-quobyte-8bffc525-8862-46d7-896a-b5a9653d23a0" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-quobyte-8bffc525-8862-46d7-896a-b5a9653d23a0" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c244f1-256e-413f-bac0-d486cc9a82f1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created reservations ['2393a0a6-de89-4be0-a6f6-4e905bdf8bf2', 'c9b8cce4-a2ce-408d-86f4-035c94045c9b', '5017eb75-8c7d-4112-a143-9f184c7651ed', '530b608b-c79a-4e5b-8c64-80cd3c09214c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:54:59 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:59 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:54:59 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d" returned: 0 in 0.472s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1371796125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c554c483-f0fa-4898-ab31-459ff22e243b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c299c5ccac04991be5ad8ac6691cc70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:54:59Z,use_quota=True,user_id='833e6e12d89b42c08984a68192be4029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c8e7b9f-82fe-4c12-91af-e08d9f39a2eb),volume_type_id=4c8e7b9f-82fe-4c12-91af-e08d9f39a2eb)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Creating volume c554c483-f0fa-4898-ab31-459ff22e243b {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:54:59 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f87e0e-948c-4882-9b22-22054b3bae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c912308b-d8c4-4128-a0af-3905daa6387d', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b 1073741824 Apr 21 20:54:59 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746afabc-bd05-4aae-90a9-479eb1e25662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:54:59 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Volume volume-c912308b-d8c4-4128-a0af-3905daa6387d (c912308b-d8c4-4128-a0af-3905daa6387d): created successfully Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746afabc-bd05-4aae-90a9-479eb1e25662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Flow 'volume_create_manager' (97280016-5172-490a-9498-1b9e7b5ec090) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:54:59 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-a35abe47-0565-4d09-b624-aafb35cafb5f req-3e628d7f-fa7f-49ce-b3c0-9ce0bb5a2c4e tempest-VolumesSnapshotsTestJSON-761282481 None] Created volume successfully. Apr 21 20:54:59 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.479s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:54:59 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Deleted volume successfully. Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.571s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:54:59 devstack sudo[86596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0 Apr 21 20:54:59 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4775e9bc-dddb-477e-b101-3b42af881b2f tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-3f8c4544-fb80-49de-b7e6-e6ae4553730e-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:54:59 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b 1073741824" returned: 0 in 0.566s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:54:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b Apr 21 20:55:00 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-b3d461a8-2949-43d3-be3c-12f1b2699fbd-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-b3d461a8-2949-43d3-be3c-12f1b2699fbd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-quobyte-b3d461a8-2949-43d3-be3c-12f1b2699fbd" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-b3d461a8-2949-43d3-be3c-12f1b2699fbd" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db2bab-e660-46f7-bfaa-f62c1a080369]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd Apr 21 20:55:00 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8bffc525-8862-46d7-896a-b5a9653d23a0" returned: 0 in 0.486s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-quobyte-8bffc525-8862-46d7-896a-b5a9653d23a0" released by "delete_volume" :: held 1.089s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Created reservations ['88c3f9ad-8ae8-4a48-a2af-e359b8dbb80f', 'ddb85b45-c6c5-40ff-84a4-01104e319201', '10d8624b-58d7-466a-bd14-f0d80b5cd4fc', '4f4c84f0-b832-4e0a-bdb4-ea4f554843aa'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:00 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.475s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c869cf-6112-4ace-b12a-a86d1e88f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c554c483-f0fa-4898-ab31-459ff22e243b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0f40df-3f7b-4dfa-bb7a-a25caeea521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Creating offline snapshot 3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 of volume c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:00 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Volume volume-c554c483-f0fa-4898-ab31-459ff22e243b (c554c483-f0fa-4898-ab31-459ff22e243b): created successfully Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0f40df-3f7b-4dfa-bb7a-a25caeea521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Flow 'volume_create_manager' (ed44afd3-586b-456c-9e1b-17d1b64940fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3501ec-0d84-4355-a501-01a7d2775c77]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-bd690e89-ea91-434f-a6b3-b7365fb318d5 tempest-VolumeTypesAccessTest-982659697 None] Created volume successfully. Apr 21 20:55:00 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d Apr 21 20:55:00 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd" returned: 0 in 0.512s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:00 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd Apr 21 20:55:00 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:00 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Acquiring lock "cinder-c554c483-f0fa-4898-ab31-459ff22e243b-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.497s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:00 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Deleted volume successfully. Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-717e3fb2-9cac-4b67-904d-18d2dd761b21 tempest-VolumesActionsTest-1598520617 None] Lock "cinder-8bffc525-8862-46d7-896a-b5a9653d23a0-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Lock "cinder-c554c483-f0fa-4898-ab31-459ff22e243b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Acquiring lock "cinder-quobyte-c554c483-f0fa-4898-ab31-459ff22e243b" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Lock "cinder-quobyte-c554c483-f0fa-4898-ab31-459ff22e243b" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1768a61-d60e-4ceb-a782-ef31361f1f5b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d" returned: 0 in 0.527s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 1G Apr 21 20:55:01 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b Apr 21 20:55:01 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b3d461a8-2949-43d3-be3c-12f1b2699fbd" returned: 0 in 0.428s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-b3d461a8-2949-43d3-be3c-12f1b2699fbd" released by "delete_volume" :: held 0.965s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created reservations ['5c4897b6-847f-417f-8baf-fc7c314810ec', '42080626-6142-4fd9-a244-e106619e855c', '5807a103-59e9-46ab-aeca-1ba11864d4d7', '71b93fa9-69d7-4057-995d-725d49de985b'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:01 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b" returned: 0 in 0.544s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 1G" returned: 0 in 0.543s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c912308b-d8c4-4128-a0af-3905daa6387d -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:01 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b Apr 21 20:55:01 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c912308b-d8c4-4128-a0af-3905daa6387d -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 Apr 21 20:55:01 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:01 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.463s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:01 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Deleted volume successfully. Apr 21 20:55:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-23dabca5-5217-4cae-a605-cc213e4de3cc tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-b3d461a8-2949-43d3-be3c-12f1b2699fbd-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:02 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c554c483-f0fa-4898-ab31-459ff22e243b" returned: 0 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Lock "cinder-quobyte-c554c483-f0fa-4898-ab31-459ff22e243b" released by "delete_volume" :: held 1.043s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c912308b-d8c4-4128-a0af-3905daa6387d -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" returned: 0 in 0.474s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 is being set with open permissions: ugo+rw Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 Apr 21 20:55:02 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack cinder-volume[81991]: WARNING cinder.quota [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1990266152 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1990266152, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:02 devstack cinder-volume[81991]: WARNING cinder.quota [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1990266152 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1990266152, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Created reservations ['fa99f8ac-f2de-4719-8f77-01532adada9b', 'dd0906e9-07cb-4e14-9829-9bba0c842739', 'eeab9960-59e0-4faa-9e16-d87cc82f213f', '1f74990a-8c0e-416b-9b88-8dcfd218da49'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:02 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-45259b2a-6cee-420d-90a1-cf190ee663de-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-45259b2a-6cee-420d-90a1-cf190ee663de-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "cinder-quobyte-45259b2a-6cee-420d-90a1-cf190ee663de" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-45259b2a-6cee-420d-90a1-cf190ee663de" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac045c19-3670-46ef-b819-bb9b4d6c654f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de Apr 21 20:55:02 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" returned: 0 in 0.465s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info Apr 21 20:55:02 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.528s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:02 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Deleted volume successfully. Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4d4a1a31-bf1e-4ef0-bcbf-7afb5864e0a1 tempest-VolumeTypesAccessTest-982659697 None] Lock "cinder-c554c483-f0fa-4898-ab31-459ff22e243b-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:02 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de" returned: 0 in 0.548s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:02 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de Apr 21 20:55:02 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:02 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:02 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info is being set with open permissions: ugo+rw Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info Apr 21 20:55:03 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-45259b2a-6cee-420d-90a1-cf190ee663de" returned: 0 in 0.502s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-quobyte-45259b2a-6cee-420d-90a1-cf190ee663de" released by "delete_volume" :: held 1.087s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Created reservations ['ceca5467-8668-41b5-8bbc-13fd7b24ac26', '15f26fe6-a232-45c7-b929-b32ebc83fe96', '1af610d8-9a5f-43b4-8f19-b99a5f9e66d7', '3c529dd0-7ba2-4315-921b-97b219ab993f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:03 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:03 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:03 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.info" returned: 0 in 0.705s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:03 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-cc74f935-368f-4f4c-a79c-f232a6c91b79 req-8977664a-ebb7-45f4-ac71-7763683b60d1 tempest-VolumesSnapshotsTestJSON-761282481 None] Create snapshot completed successfully Apr 21 20:55:04 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.516s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Deleted volume successfully. Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d0884f9b-4ca9-440b-8d5e-042e53ccd54c tempest-CreateVolumesFromSourceVolumeTest-1396850782 None] Lock "cinder-45259b2a-6cee-420d-90a1-cf190ee663de-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "cinder-3562f57a-2f93-4e8c-ba14-1c47b3cc87c9-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-3562f57a-2f93-4e8c-ba14-1c47b3cc87c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "cinder-quobyte-c912308b-d8c4-4128-a0af-3905daa6387d" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-quobyte-c912308b-d8c4-4128-a0af-3905daa6387d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "cinder-quobyte-3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-quobyte-3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Deleting offline snapshot 3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 of volume c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] snapshot_file for this snap is: volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5e911-b9a2-499e-9e2e-fb2e669b242f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:04 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 Apr 21 20:55:04 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:05 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" returned: 0 in 0.640s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c912308b-d8c4-4128-a0af-3905daa6387d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:05 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bccc7c-9682-4e1a-b2d3-07536bce2d28]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:05 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d Apr 21 20:55:05 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:05 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d" returned: 0 in 0.645s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:05 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 Apr 21 20:55:05 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Flow 'volume_create_manager' (1a9d8489-4051-4351-8b54-1932f3256417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9c768f-d430-44c4-add8-1eb5548a6dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9c768f-d430-44c4-add8-1eb5548a6dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1279495672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f237bb-0659-493c-ab96-0f68b9a4e338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a338db5e3844144b94a8eca818ec1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:06Z,use_quota=True,user_id='3611c8d7b9a1425da8cf9e39f8b88a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638e2569-f331-4b96-9762-3fffa048067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638e2569-f331-4b96-9762-3fffa048067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f293af9f-6ed2-4478-9fff-8a257ac06389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f293af9f-6ed2-4478-9fff-8a257ac06389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f237bb-0659-493c-ab96-0f68b9a4e338', 'volume_name': 'volume-91f237bb-0659-493c-ab96-0f68b9a4e338', 'volume_size': 2}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7de0d10-3224-4b8e-9ef9-260dc84bf645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7de0d10-3224-4b8e-9ef9-260dc84bf645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07373cbb-981f-4027-b64d-ecb77e214a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:06 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Volume 91f237bb-0659-493c-ab96-0f68b9a4e338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f237bb-0659-493c-ab96-0f68b9a4e338', 'volume_size': 2} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1279495672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f237bb-0659-493c-ab96-0f68b9a4e338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a338db5e3844144b94a8eca818ec1e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:06Z,use_quota=True,user_id='3611c8d7b9a1425da8cf9e39f8b88a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Creating volume 91f237bb-0659-493c-ab96-0f68b9a4e338 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:06 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 2147483648 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 2147483648 Apr 21 20:55:06 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" returned: 0 in 0.582s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9 Apr 21 20:55:06 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 2147483648" returned: 0 in 0.734s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:06 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d.3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" returned: 0 in 0.561s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:06 devstack sudo[86694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 Apr 21 20:55:06 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-quobyte-3562f57a-2f93-4e8c-ba14-1c47b3cc87c9" released by "_delete_snapshot" :: held 2.504s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-quobyte-c912308b-d8c4-4128-a0af-3905daa6387d" released by "delete_snapshot" :: held 2.519s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.quota [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Created reservations ['1efe6b38-020c-40c0-b122-2425640988f7', '5a82fbad-2d48-4022-bdbf-5cddc0d2d763', '28b700c3-cffb-4dea-8846-12a4e28f9788', '786a1629-8c93-418d-a0d8-82ff66859184'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:07 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Delete snapshot completed successfully. Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-cdf47098-53dc-4f38-8143-e7ca1ab783b8 req-703a9dc2-4d14-45ac-9f4f-871672478301 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-3562f57a-2f93-4e8c-ba14-1c47b3cc87c9-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:07 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07373cbb-981f-4027-b64d-ecb77e214a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f237bb-0659-493c-ab96-0f68b9a4e338', 'volume_size': 2}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc1fe7-0516-41f4-a058-56c1e1e70a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Volume volume-91f237bb-0659-493c-ab96-0f68b9a4e338 (91f237bb-0659-493c-ab96-0f68b9a4e338): created successfully Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc1fe7-0516-41f4-a058-56c1e1e70a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Flow 'volume_create_manager' (1a9d8489-4051-4351-8b54-1932f3256417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:07 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-983ae72b-dd51-45e3-9c7b-56911aef73ec tempest-VolumesCloneNegativeTest-1157857822 None] Created volume successfully. Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "cinder-c912308b-d8c4-4128-a0af-3905daa6387d-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-c912308b-d8c4-4128-a0af-3905daa6387d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "cinder-quobyte-c912308b-d8c4-4128-a0af-3905daa6387d" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-quobyte-c912308b-d8c4-4128-a0af-3905daa6387d" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0dd985-2058-4aae-88b7-a0c892d01d74]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:07 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d Apr 21 20:55:07 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Acquiring lock "cinder-91f237bb-0659-493c-ab96-0f68b9a4e338-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Lock "cinder-91f237bb-0659-493c-ab96-0f68b9a4e338-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Acquiring lock "cinder-quobyte-91f237bb-0659-493c-ab96-0f68b9a4e338" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Lock "cinder-quobyte-91f237bb-0659-493c-ab96-0f68b9a4e338" acquired by "delete_volume" :: waited 0.021s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[83591000-d50e-48cd-9634-991918bbacc6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:08 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d" returned: 0 in 0.631s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:08 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:08 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:08 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d Apr 21 20:55:08 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:08 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-c912308b-d8c4-4128-a0af-3905daa6387d" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-quobyte-c912308b-d8c4-4128-a0af-3905daa6387d" released by "delete_volume" :: held 1.207s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.quota [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Created reservations ['22257ff5-7c82-483a-add6-8d03e3cc8c92', '54203a1f-8896-486e-81d8-b640bac17ad1', '1e7dd5a6-6550-406e-93e3-dd2b2e9226ac', '9e4c0b6f-c721-49e8-92f8-3afb2c673278'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:09 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338" returned: 0 in 0.674s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:09 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338 Apr 21 20:55:09 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:09 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:09 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:09 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-91f237bb-0659-493c-ab96-0f68b9a4e338" returned: 0 in 0.556s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Lock "cinder-quobyte-91f237bb-0659-493c-ab96-0f68b9a4e338" released by "delete_volume" :: held 1.259s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:09 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.541s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.manager [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Deleted volume successfully. Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [req-8cc3f473-2864-47fe-9cac-37c75bfc9fe5 req-308b8b6a-f599-4f1d-ba39-5b31f25a0a41 tempest-VolumesSnapshotsTestJSON-761282481 None] Lock "cinder-c912308b-d8c4-4128-a0af-3905daa6387d-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Created reservations ['342da959-6f1b-4e4e-aa8e-0d2a09aaeefb', '2cd56668-38b8-43bc-8867-6ad27d23dd9c', '7d8bd912-f67a-4a02-b586-03bf6c9f67c6', 'd766a3ec-0da3-4444-9d27-b74ca742a598'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:09 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:09 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:10 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.601s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:10 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Deleted volume successfully. Apr 21 20:55:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2c6f49b-9047-4733-a97f-57d4d9e68aaf tempest-VolumesCloneNegativeTest-1157857822 None] Lock "cinder-91f237bb-0659-493c-ab96-0f68b9a4e338-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Flow 'volume_create_manager' (6de9a9e1-cfa6-4a43-878c-465e215e6eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc51ce4-e239-45c0-b2c0-eec997359f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc51ce4-e239-45c0-b2c0-eec997359f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1745234915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891f8f6d-a98c-4a70-aa82-a98630e394a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7174ddbba421f9b838c315b6dbddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:14Z,use_quota=True,user_id='905ff451f810481da187a4b534f5b750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5f90d8-271c-444d-adf5-156548d65afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5f90d8-271c-444d-adf5-156548d65afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8700e5-9dbc-417e-ba1f-ee65ace64106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.image.glance [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Creating Keystone auth plugin from conf {{(pid=81991) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8700e5-9dbc-417e-ba1f-ee65ace64106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '891f8f6d-a98c-4a70-aa82-a98630e394a5', 'volume_name': 'volume-891f8f6d-a98c-4a70-aa82-a98630e394a5', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770f74c2-47b4-450e-b504-2070c76b2957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (770f74c2-47b4-450e-b504-2070c76b2957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc76856-df10-458a-93b1-b65c2c1857ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:14 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Volume 891f8f6d-a98c-4a70-aa82-a98630e394a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-891f8f6d-a98c-4a70-aa82-a98630e394a5', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Trying to clone 891f8f6d-a98c-4a70-aa82-a98630e394a5 from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]). {{(pid=81991) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:55:14 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33e00b-a9ed-4469-8164-cb95240a95f5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:14 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD Apr 21 20:55:14 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:15 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:15 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 is fetched for user 905ff451f810481da187a4b534f5b750. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:55:15 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21f2bcd-3cc4-46aa-a6d2-0a8d209500c8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:15 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD Apr 21 20:55:15 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:16 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1745234915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891f8f6d-a98c-4a70-aa82-a98630e394a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7174ddbba421f9b838c315b6dbddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:14Z,use_quota=True,user_id='905ff451f810481da187a4b534f5b750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Creating volume 891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:16 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:16 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 1073741824 Apr 21 20:55:16 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:16 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 1073741824" returned: 0 in 0.668s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:16 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:16 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:17 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 0 in 0.556s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:17 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Attempting download of 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume 891f8f6d-a98c-4a70-aa82-a98630e394a5. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:55:17 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283f4a3-7a79-4ca3-b1ce-1ccd444d3769]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:17 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv Apr 21 20:55:17 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f1288a35-9521-43ff-8eeb-aeb2c2121f93 tempest-GroupSnapshotsV319Test-844939293 None] Group tempest-GroupSnapshotsV319Test-Group-1183663088: creating Apr 21 20:55:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f1288a35-9521-43ff-8eeb-aeb2c2121f93 tempest-GroupSnapshotsV319Test-844939293 None] Group tempest-GroupSnapshotsV319Test-Group-1183663088: created successfully Apr 21 20:55:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f1288a35-9521-43ff-8eeb-aeb2c2121f93 tempest-GroupSnapshotsV319Test-844939293 None] Create group completed successfully. Apr 21 20:55:18 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv" returned: 0 in 0.593s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:18 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv Apr 21 20:55:18 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:18 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv" returned: 1 in 0.531s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_dcft66bv' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:18 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a65082-d3af-4610-b5d3-14a688d6689b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:18 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD Apr 21 20:55:18 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 was qcow2, converting to raw {{(pid=81991) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:19 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Flow 'volume_create_manager' (82e3e953-9939-42b9-91ae-8c371cfa9347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72b905f-a765-40de-a24f-84f6eb8ec557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e72b905f-a765-40de-a24f-84f6eb8ec557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-888750142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5baa45d2-5ebe-46ae-8662-97a82d6a87f9,host='devstack@QuobyteHD#QuobyteHD',id=7261f27c-5675-4b5a-ab0d-525b5383caff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508a4cb92c0948899cb6ddcd82774265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:19Z,use_quota=True,user_id='ec6e417b15e648be84bb4071d97c69ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c409e5cc-29ab-47cc-832d-482f0af0128f),volume_type_id=c409e5cc-29ab-47cc-832d-482f0af0128f)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80b511b-5dbb-481d-9e12-e1c1ea915214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80b511b-5dbb-481d-9e12-e1c1ea915214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b8fa7b-496d-45a0-a78f-e184a851e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b8fa7b-496d-45a0-a78f-e184a851e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7261f27c-5675-4b5a-ab0d-525b5383caff', 'volume_name': 'volume-7261f27c-5675-4b5a-ab0d-525b5383caff', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3560190-eadb-4b78-bfd7-4e40dbd319a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3560190-eadb-4b78-bfd7-4e40dbd319a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151e58b5-4c80-4fe8-bbca-547096a2396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:19 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Volume 7261f27c-5675-4b5a-ab0d-525b5383caff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7261f27c-5675-4b5a-ab0d-525b5383caff', 'volume_size': 1} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5baa45d2-5ebe-46ae-8662-97a82d6a87f9,created_at=2026-04-21T18:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-888750142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5baa45d2-5ebe-46ae-8662-97a82d6a87f9,host='devstack@QuobyteHD#QuobyteHD',id=7261f27c-5675-4b5a-ab0d-525b5383caff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508a4cb92c0948899cb6ddcd82774265',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:19Z,use_quota=True,user_id='ec6e417b15e648be84bb4071d97c69ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c409e5cc-29ab-47cc-832d-482f0af0128f),volume_type_id=c409e5cc-29ab-47cc-832d-482f0af0128f)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Creating volume 7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:19 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:19 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff 1073741824 Apr 21 20:55:19 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:20 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff 1073741824" returned: 0 in 0.592s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:20 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff Apr 21 20:55:20 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:20 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 0 in 1.244s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_axuedfexdevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:20 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Converted 112.00 MB image at 89.91 MB/s Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:20 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 1G Apr 21 20:55:20 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:20 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff" returned: 0 in 0.665s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151e58b5-4c80-4fe8-bbca-547096a2396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7261f27c-5675-4b5a-ab0d-525b5383caff', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec9431c-50f4-46d7-9026-3550ff6a61d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:20 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Volume volume-7261f27c-5675-4b5a-ab0d-525b5383caff (7261f27c-5675-4b5a-ab0d-525b5383caff): created successfully Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec9431c-50f4-46d7-9026-3550ff6a61d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Flow 'volume_create_manager' (82e3e953-9939-42b9-91ae-8c371cfa9347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:20 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1acdbd23-4cd3-4f28-8431-f0d6f4ba1110 tempest-GroupSnapshotsV319Test-844939293 None] Created volume successfully. Apr 21 20:55:20 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 1G" returned: 0 in 0.589s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561ad04-1e5b-4349-87a5-d9812471f518]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:21 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 0 in 0.607s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] GroupSnapshot b0d916b7-49f5-4ff8-bbc2-ec8a4cf31f50: creating. Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Group snapshot b0d916b7-49f5-4ff8-bbc2-ec8a4cf31f50: creating. {{(pid=81991) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Creating offline snapshot 2f06fa6b-74da-4a74-a6f8-03299c52d40b of volume 7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:21 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:21 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[871961ad-ea07-4d88-9773-205aaf402acb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:21 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff Apr 21 20:55:21 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 1 in 0.688s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Downloaded image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume 891f8f6d-a98c-4a70-aa82-a98630e394a5 successfully. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 for user 905ff451f810481da187a4b534f5b750 is deleted. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Marking volume 891f8f6d-a98c-4a70-aa82-a98630e394a5 as bootable. {{(pid=81991) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Copying metadata from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 to 891f8f6d-a98c-4a70-aa82-a98630e394a5. {{(pid=81991) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Creating volume glance metadata for volume 891f8f6d-a98c-4a70-aa82-a98630e394a5 backed by image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81991) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:55:22 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff" returned: 0 in 0.606s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b 1G Apr 21 20:55:22 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc76856-df10-458a-93b1-b65c2c1857ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891f8f6d-a98c-4a70-aa82-a98630e394a5', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301d8fb4-e3c6-4deb-ab1c-8a99a73ac70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:22 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Volume volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 (891f8f6d-a98c-4a70-aa82-a98630e394a5): created successfully Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301d8fb4-e3c6-4deb-ab1c-8a99a73ac70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Flow 'volume_create_manager' (6de9a9e1-cfa6-4a43-878c-465e215e6eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-46f724c1-0485-4834-860f-e3261fdc9e10 tempest-VolumesExtendTest-1245841209 None] Created volume successfully. Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:22 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b 1G" returned: 0 in 0.602s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7261f27c-5675-4b5a-ab0d-525b5383caff -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:22 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7261f27c-5675-4b5a-ab0d-525b5383caff -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b Apr 21 20:55:22 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:23 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7261f27c-5675-4b5a-ab0d-525b5383caff -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b" returned: 0 in 0.588s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:23 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:55:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:23 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b Apr 21 20:55:23 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b" returned: 0 in 0.551s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:24 devstack sudo[87065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info Apr 21 20:55:24 devstack sudo[87065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:24 devstack sudo[87065]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info" returned: 0 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:24 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info is being set with open permissions: ugo+rw: NotImplementedError Apr 21 20:55:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:24 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info Apr 21 20:55:24 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.info" returned: 0 in 0.559s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.395s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb0def-ebde-4f93-8a4d-16cc5baeb8f4]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b306fc43-f65b-413c-9c41-056d5eedba5d tempest-GroupSnapshotsV319Test-844939293 None] group_snapshot b0d916b7-49f5-4ff8-bbc2-ec8a4cf31f50: created successfully Apr 21 20:55:25 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:25 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 0 in 0.559s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:25 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:25 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Flow 'volume_create_manager' (aae67e9e-97d7-4e9f-b1ae-fc4290c87bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7ccbcc-643d-40a7-9160-7399529dc616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7ccbcc-643d-40a7-9160-7399529dc616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-447454972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549c05e76afb4bcf90d760d45f9d9c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:26Z,use_quota=True,user_id='0d34e3921862456eb7def6ee910b82f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c002d6c-5dec-4d15-ae1f-70ddd4ececdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c002d6c-5dec-4d15-ae1f-70ddd4ececdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0940f150-891e-4ade-beec-dfb2b6b94dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0940f150-891e-4ade-beec-dfb2b6b94dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac', 'volume_name': 'volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742e6dc5-98c6-4cb7-a990-e8d4827c2353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742e6dc5-98c6-4cb7-a990-e8d4827c2353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8705b4a1-a05e-4a87-afbf-4c6287ef65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:26 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Volume 00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac', 'volume_size': 1} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] group_snapshot b0d916b7-49f5-4ff8-bbc2-ec8a4cf31f50: deleting Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] group_snapshot b0d916b7-49f5-4ff8-bbc2-ec8a4cf31f50: deleting {{(pid=81991) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "cinder-quobyte-7261f27c-5675-4b5a-ab0d-525b5383caff" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Lock "cinder-quobyte-7261f27c-5675-4b5a-ab0d-525b5383caff" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "cinder-quobyte-2f06fa6b-74da-4a74-a6f8-03299c52d40b" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Lock "cinder-quobyte-2f06fa6b-74da-4a74-a6f8-03299c52d40b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Deleting offline snapshot 2f06fa6b-74da-4a74-a6f8-03299c52d40b of volume 7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] snapshot_file for this snap is: volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f00d5-a698-47ed-ac20-8f877ba582db]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b Apr 21 20:55:26 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:26 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 1 in 0.693s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 2G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 2G" returned: 0 in 0.037s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.334s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-447454972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549c05e76afb4bcf90d760d45f9d9c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:26Z,use_quota=True,user_id='0d34e3921862456eb7def6ee910b82f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Creating volume 00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:26 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac 1073741824 Apr 21 20:55:26 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-156b7aac-b5af-4ab0-8ae7-6344f9f72466 tempest-VolumesExtendTest-1245841209 None] Extend volume completed successfully. Apr 21 20:55:26 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b" returned: 0 in 0.541s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7261f27c-5675-4b5a-ab0d-525b5383caff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8696d274-15ab-4a13-9e2b-987296d17109]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:26 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff Apr 21 20:55:26 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac 1073741824" returned: 0 in 0.594s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:27 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-891f8f6d-a98c-4a70-aa82-a98630e394a5-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-891f8f6d-a98c-4a70-aa82-a98630e394a5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-quobyte-891f8f6d-a98c-4a70-aa82-a98630e394a5" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-891f8f6d-a98c-4a70-aa82-a98630e394a5" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b221d1ad-d87d-43a9-8995-fc8c5e00ff20]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff" returned: 0 in 0.593s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:27 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b Apr 21 20:55:27 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:27 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:27 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.725s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8705b4a1-a05e-4a87-afbf-4c6287ef65cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917e7a38-85b1-4c25-a68b-7d880094b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:27 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Volume volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac (00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac): created successfully Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917e7a38-85b1-4c25-a68b-7d880094b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Flow 'volume_create_manager' (aae67e9e-97d7-4e9f-b1ae-fc4290c87bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:27 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-61f039f4-e5dd-43f4-9308-619231dbbc1f tempest-SnapshotDependencyTests-491832474 None] Created volume successfully. Apr 21 20:55:28 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b" returned: 0 in 0.586s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b Apr 21 20:55:28 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:28 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 0 in 0.855s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Creating offline snapshot 02d08727-e981-4cc7-bd4d-0dcb2611fcf3 of volume 00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2bf4b-4251-4d45-b09e-57a0eee71b4b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:28 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:28 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff.2f06fa6b-74da-4a74-a6f8-03299c52d40b" returned: 0 in 0.511s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Lock "cinder-quobyte-2f06fa6b-74da-4a74-a6f8-03299c52d40b" released by "_delete_snapshot" :: held 2.288s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Lock "cinder-quobyte-7261f27c-5675-4b5a-ab0d-525b5383caff" released by "delete_snapshot" :: held 2.301s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:28 devstack cinder-volume[81991]: WARNING cinder.quota [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1435538320 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1435538320, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:28 devstack cinder-volume[81991]: WARNING cinder.quota [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1435538320 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1435538320, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] Created reservations ['60164793-3f50-4f09-9dec-4caeb96ab74e', '217dcbc2-2e79-4201-b49d-30363d01904f', '46e137eb-9772-4e16-8175-7e3bd42c4977', '9dfe7a39-8003-4cf3-af6f-cecc90171c4c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:28 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-21677959-6eca-4132-8497-e1a3b3d62cb0 tempest-GroupSnapshotsV319Test-844939293 None] group_snapshot b0d916b7-49f5-4ff8-bbc2-ec8a4cf31f50: deleted successfully Apr 21 20:55:28 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 1 in 0.632s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5 Apr 21 20:55:28 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:28 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.673s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:28 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 1G Apr 21 20:55:28 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-891f8f6d-a98c-4a70-aa82-a98630e394a5" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-891f8f6d-a98c-4a70-aa82-a98630e394a5" released by "delete_volume" :: held 2.015s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Created reservations ['3bee10f1-2699-4bf2-b21c-33d7f7d745d4', 'd011d1bb-f5a4-4764-b412-c7151203fce1', '051b30c2-3366-48c5-b470-7715f3808276', '94112853-1182-4d17-9e13-9d83af3008ab'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:29 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 1G" returned: 0 in 0.563s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:29 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:29 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 Apr 21 20:55:29 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "cinder-quobyte-7261f27c-5675-4b5a-ab0d-525b5383caff" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Lock "cinder-quobyte-7261f27c-5675-4b5a-ab0d-525b5383caff" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[656146dd-0d26-45a3-8f43-18d6bb184618]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff Apr 21 20:55:30 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Flow 'volume_create_manager' (962e64ec-a5a6-4812-bd96-c658069701d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d428e1e4-3715-444a-a686-ab08d16cbf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d428e1e4-3715-444a-a686-ab08d16cbf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-916794253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824e46f8-004f-4e0c-8588-f1e05b07df00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7174ddbba421f9b838c315b6dbddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:30Z,use_quota=True,user_id='905ff451f810481da187a4b534f5b750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688893d7-b47e-4861-bfb0-4c86574cb72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688893d7-b47e-4861-bfb0-4c86574cb72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9bcca1-515f-4844-9dcf-eeb0c9cf3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9bcca1-515f-4844-9dcf-eeb0c9cf3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824e46f8-004f-4e0c-8588-f1e05b07df00', 'volume_name': 'volume-824e46f8-004f-4e0c-8588-f1e05b07df00', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad22433-3a15-4101-8557-54db007ebf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad22433-3a15-4101-8557-54db007ebf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a463d7-d674-48e4-962a-58050b16a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:30 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Volume 824e46f8-004f-4e0c-8588-f1e05b07df00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824e46f8-004f-4e0c-8588-f1e05b07df00', 'volume_size': 1} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:30 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3" returned: 0 in 0.675s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 is being set with open permissions: ugo+rw Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 Apr 21 20:55:30 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.741s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:30 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Deleted volume successfully. Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-18fe9ed7-14de-4f44-9e09-d1cd80c1f017 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-891f8f6d-a98c-4a70-aa82-a98630e394a5-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:30 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff" returned: 0 in 0.726s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff Apr 21 20:55:30 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3" returned: 0 in 0.496s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:30 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:30 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info Apr 21 20:55:30 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7261f27c-5675-4b5a-ab0d-525b5383caff" returned: 0 in 0.493s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Lock "cinder-quobyte-7261f27c-5675-4b5a-ab0d-525b5383caff" released by "delete_volume" :: held 1.257s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Created reservations ['5a56114a-0d9b-4d1d-994d-6af38d7dbd59'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:31 devstack cinder-volume[81991]: WARNING cinder.quota [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1435538320 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1435538320, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Created reservations ['76c14866-0ef1-49da-8ed6-d2a5b100b99c', 'bcb879a4-dcd2-498c-b798-df74bf2e00d4', 'e60c068c-92e0-492a-b0f8-e4b4baa909fe', '6dc8dff3-3613-43c4-bfeb-8d8d90708e63'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:31 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info is being set with open permissions: ugo+rw Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info Apr 21 20:55:31 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:31 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.info" returned: 0 in 0.438s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.386s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-916794253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824e46f8-004f-4e0c-8588-f1e05b07df00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37f7174ddbba421f9b838c315b6dbddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:30Z,use_quota=True,user_id='905ff451f810481da187a4b534f5b750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Creating volume 824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:31 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:31 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:31 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 1073741824 Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:31 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:31 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-086a7725-a10d-4ab5-8cf6-13b01eb024ee tempest-GroupSnapshotsV319Test-844939293 None] Delete group completed successfully. Apr 21 20:55:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6a79f4c1-2459-48f6-b187-0d3129c68730 tempest-SnapshotDependencyTests-491832474 None] Create snapshot completed successfully Apr 21 20:55:32 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 1073741824" returned: 0 in 0.607s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:32 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 Apr 21 20:55:32 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Flow 'volume_create_manager' (560c9bf6-29da-4518-9800-ed9a1fe4c655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df448dd-30e5-461b-944d-5e5e67891090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df448dd-30e5-461b-944d-5e5e67891090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3e1085-18b5-4dc5-b949-47389c789044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='549c05e76afb4bcf90d760d45f9d9c0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02d08727-e981-4cc7-bd4d-0dcb2611fcf3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:33Z,use_quota=True,user_id='0d34e3921862456eb7def6ee910b82f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea65eeaf-7095-41ea-ad03-8fb26b5bfea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea65eeaf-7095-41ea-ad03-8fb26b5bfea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae8e8c5-7206-4109-b184-9d145cc2ded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae8e8c5-7206-4109-b184-9d145cc2ded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf3e1085-18b5-4dc5-b949-47389c789044', 'volume_name': 'volume-bf3e1085-18b5-4dc5-b949-47389c789044', 'volume_size': 1, 'snapshot_id': '02d08727-e981-4cc7-bd4d-0dcb2611fcf3'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb727dd-0b71-44c6-99d2-a45ada485f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb727dd-0b71-44c6-99d2-a45ada485f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108f2bc6-1db7-48ce-b3c1-99ff05144cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Volume bf3e1085-18b5-4dc5-b949-47389c789044: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf3e1085-18b5-4dc5-b949-47389c789044', 'volume_size': 1, 'snapshot_id': '02d08727-e981-4cc7-bd4d-0dcb2611fcf3'} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00" returned: 0 in 0.614s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-quobyte-02d08727-e981-4cc7-bd4d-0dcb2611fcf3-bf3e1085-18b5-4dc5-b949-47389c789044" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a463d7-d674-48e4-962a-58050b16a83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824e46f8-004f-4e0c-8588-f1e05b07df00', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5189efdc-5a4c-4235-885d-930282cadec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-02d08727-e981-4cc7-bd4d-0dcb2611fcf3-bf3e1085-18b5-4dc5-b949-47389c789044" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Creating volume bf3e1085-18b5-4dc5-b949-47389c789044 from snapshot 02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-quobyte-bf3e1085-18b5-4dc5-b949-47389c789044" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:32 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Volume volume-824e46f8-004f-4e0c-8588-f1e05b07df00 (824e46f8-004f-4e0c-8588-f1e05b07df00): created successfully Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5189efdc-5a4c-4235-885d-930282cadec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Flow 'volume_create_manager' (962e64ec-a5a6-4812-bd96-c658069701d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:32 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c66b8adb-c872-4cae-862d-f2f0c972d5e7 tempest-VolumesExtendTest-1245841209 None] Created volume successfully. Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-bf3e1085-18b5-4dc5-b949-47389c789044" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] snapshot: 02d08727-e981-4cc7-bd4d-0dcb2611fcf3, volume: bf3e1085-18b5-4dc5-b949-47389c789044, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e7c32b-d114-4275-822f-4b98fdcd7813]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:33 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 Apr 21 20:55:33 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:33 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3" returned: 0 in 0.671s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99fd7a2-18d0-49d8-908d-40269666ed5f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:33 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:33 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:34 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.689s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:34 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:55:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:34 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 Apr 21 20:55:34 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:36 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044" returned: 0 in 2.355s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9900e9-255b-4b7f-84b3-58be0e143f3d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:36 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:36 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:37 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.715s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac, size 1024.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:55:37 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Converted 1024.00 MB image at 434.48 MB/s Apr 21 20:55:37 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 is being set with open permissions: ugo+rw Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:37 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 Apr 21 20:55:37 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:37 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-bf3e1085-18b5-4dc5-b949-47389c789044" released by "_copy_volume_from_snapshot" :: held 4.988s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-02d08727-e981-4cc7-bd4d-0dcb2611fcf3-bf3e1085-18b5-4dc5-b949-47389c789044" released by "_create_volume_from_snapshot" :: held 5.034s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.061s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.520s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Creating offline snapshot 20c860ff-17d4-4c45-98a8-33b2bea0fc12 of volume 824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d339bb-3731-4a5c-b404-cb13cdd957fe]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108f2bc6-1db7-48ce-b3c1-99ff05144cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3e1085-18b5-4dc5-b949-47389c789044', 'volume_size': 1, 'snapshot_id': '02d08727-e981-4cc7-bd4d-0dcb2611fcf3'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dbe11a-d274-4c8d-8727-23acf478ae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:38 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Volume volume-bf3e1085-18b5-4dc5-b949-47389c789044 (bf3e1085-18b5-4dc5-b949-47389c789044): created successfully Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63dbe11a-d274-4c8d-8727-23acf478ae00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Flow 'volume_create_manager' (560c9bf6-29da-4518-9800-ed9a1fe4c655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:38 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-911547a5-d961-4067-bc28-c6e5c20fc4a8 tempest-SnapshotDependencyTests-491832474 None] Created volume successfully. Apr 21 20:55:38 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 Apr 21 20:55:38 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:38 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00" returned: 0 in 0.627s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:38 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 1G Apr 21 20:55:38 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 1G" returned: 0 in 0.538s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e46f8-004f-4e0c-8588-f1e05b07df00 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e46f8-004f-4e0c-8588-f1e05b07df00 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 Apr 21 20:55:39 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-02d08727-e981-4cc7-bd4d-0dcb2611fcf3-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-02d08727-e981-4cc7-bd4d-0dcb2611fcf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-quobyte-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-quobyte-02d08727-e981-4cc7-bd4d-0dcb2611fcf3" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-02d08727-e981-4cc7-bd4d-0dcb2611fcf3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Deleting offline snapshot 02d08727-e981-4cc7-bd4d-0dcb2611fcf3 of volume 00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] snapshot_file for this snap is: volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a98ea7f-8ae7-4943-b4d3-a79b43fa15a7]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 Apr 21 20:55:39 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e46f8-004f-4e0c-8588-f1e05b07df00 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12" returned: 0 in 0.600s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 is being set with open permissions: ugo+rw Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:39 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 Apr 21 20:55:39 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:39 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3" returned: 0 in 0.583s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077a075-6b96-4175-a7cf-17b3efef9545]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:40 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12" returned: 0 in 0.490s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info Apr 21 20:55:40 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.546s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 Apr 21 20:55:40 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:40 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info" returned: 0 in 0.544s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:40 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info is being set with open permissions: ugo+rw Apr 21 20:55:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:40 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info Apr 21 20:55:40 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3" returned: 0 in 0.524s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:41 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3 Apr 21 20:55:41 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:41 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.info" returned: 0 in 0.445s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-79274a77-9681-4a68-83ef-6c009f94c2de tempest-VolumesExtendTest-1245841209 None] Create snapshot completed successfully Apr 21 20:55:41 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac.02d08727-e981-4cc7-bd4d-0dcb2611fcf3" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-02d08727-e981-4cc7-bd4d-0dcb2611fcf3" released by "_delete_snapshot" :: held 2.165s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" released by "delete_snapshot" :: held 2.178s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Created reservations ['3f173f0f-868a-4628-b231-28069678a247', '679334a4-2e9b-46c2-8603-968e6dfca293', '54378fc4-3745-4302-add8-f47bed610f43', '3913ef3e-7e2c-459c-8cad-eb1a351c34d7'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Delete snapshot completed successfully. Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2a6ef3be-5f17-4f90-85e6-d7f437273e41 tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-02d08727-e981-4cc7-bd4d-0dcb2611fcf3-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a4a955-f80a-4616-b402-e371f6e743fc]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:41 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 Apr 21 20:55:41 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1a936294-b2d9-4668-8d51-711a406235b9 tempest-GroupsTest-1289107507 None] Group tempest-Group1-2009832789: creating Apr 21 20:55:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1a936294-b2d9-4668-8d51-711a406235b9 tempest-GroupsTest-1289107507 None] Group tempest-Group1-2009832789: created successfully Apr 21 20:55:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1a936294-b2d9-4668-8d51-711a406235b9 tempest-GroupsTest-1289107507 None] Create group completed successfully. Apr 21 20:55:42 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00" returned: 0 in 0.494s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 2G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 2G" returned: 0 in 0.067s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.579s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:42 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-bc8b5a6e-b13e-403c-8277-c4da882eb0bd tempest-VolumesExtendTest-1245841209 None] Extend volume completed successfully. Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-quobyte-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[593a8840-f31a-4cce-9b07-fd6736415940]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:42 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:42 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-20c860ff-17d4-4c45-98a8-33b2bea0fc12-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Lock "cinder-20c860ff-17d4-4c45-98a8-33b2bea0fc12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-quobyte-824e46f8-004f-4e0c-8588-f1e05b07df00" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-824e46f8-004f-4e0c-8588-f1e05b07df00" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-quobyte-20c860ff-17d4-4c45-98a8-33b2bea0fc12" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-20c860ff-17d4-4c45-98a8-33b2bea0fc12" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Deleting offline snapshot 20c860ff-17d4-4c45-98a8-33b2bea0fc12 of volume 824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] snapshot_file for this snap is: volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ba8468-cd33-49ef-ad0f-a59dab6dedb0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:43 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.588s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:43 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 Apr 21 20:55:43 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac Apr 21 20:55:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-da3a8604-59fe-498e-8ecc-0a23915cd636 tempest-GroupsTest-1289107507 None] Group tempest-Group2-1964926090: creating Apr 21 20:55:43 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=156,cinder:UPDATE=187,cinder:DELETE=13,cinder:INSERT=53 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-da3a8604-59fe-498e-8ecc-0a23915cd636 tempest-GroupsTest-1289107507 None] Group tempest-Group2-1964926090: created successfully Apr 21 20:55:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-da3a8604-59fe-498e-8ecc-0a23915cd636 tempest-GroupsTest-1289107507 None] Create group completed successfully. Apr 21 20:55:43 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824e46f8-004f-4e0c-8588-f1e05b07df00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70273ea-2135-4447-b885-b0cf84bb099d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:43 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" returned: 0 in 0.548s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac" released by "delete_volume" :: held 1.176s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:43 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 Apr 21 20:55:43 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Created reservations ['c8060f5d-8694-41a1-86a8-36ae20199205', '1c343493-3cd4-4afa-a389-683ce7a223a8', '49109f67-dcf4-43c4-b793-f1d614f39c99', 'd65a937d-544d-4cbd-abe3-816a8fd16319'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:43 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:43 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00" returned: 0 in 0.620s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 Apr 21 20:55:44 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Deleted volume successfully. Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-259a2d9f-cb70-44cb-9d05-cb223f0c769d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-00d2caaa-5ddd-4b5b-a1b8-b90a3ddd4dac-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Flow 'volume_create_manager' (bac8654f-3178-483d-b5c0-1fa4ae4558b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c6f337-9086-469b-83fd-9fc6a679cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c6f337-9086-469b-83fd-9fc6a679cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062953511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd222da5-0e2d-4521-9fcf-ffd3097fb18d,host='devstack@QuobyteHD#QuobyteHD',id=25c17ae7-c4fb-465d-b158-953c605e3fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef22de7b698406388a98d02e8fcf19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:45Z,use_quota=True,user_id='d57868e563084475aade0167155aa752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9949ae2c-270f-4703-aaee-24c59d880355),volume_type_id=9949ae2c-270f-4703-aaee-24c59d880355)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e736c02-dd1f-45c9-8ad4-2f9b33a9e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e736c02-dd1f-45c9-8ad4-2f9b33a9e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558f835e-1ee2-4da5-aa26-508e76c6879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558f835e-1ee2-4da5-aa26-508e76c6879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c17ae7-c4fb-465d-b158-953c605e3fd7', 'volume_name': 'volume-25c17ae7-c4fb-465d-b158-953c605e3fd7', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4280f7d-d775-439d-809c-b50a8091a7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4280f7d-d775-439d-809c-b50a8091a7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab32985-c6fe-4b5e-8f88-306cf16314c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Volume 25c17ae7-c4fb-465d-b158-953c605e3fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c17ae7-c4fb-465d-b158-953c605e3fd7', 'volume_size': 1} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd222da5-0e2d-4521-9fcf-ffd3097fb18d,created_at=2026-04-21T18:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062953511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd222da5-0e2d-4521-9fcf-ffd3097fb18d,host='devstack@QuobyteHD#QuobyteHD',id=25c17ae7-c4fb-465d-b158-953c605e3fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef22de7b698406388a98d02e8fcf19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:45Z,use_quota=True,user_id='d57868e563084475aade0167155aa752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9949ae2c-270f-4703-aaee-24c59d880355),volume_type_id=9949ae2c-270f-4703-aaee-24c59d880355)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Creating volume 25c17ae7-c4fb-465d-b158-953c605e3fd7 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:44 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 1073741824 Apr 21 20:55:44 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-bf3e1085-18b5-4dc5-b949-47389c789044-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-bf3e1085-18b5-4dc5-b949-47389c789044-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "cinder-quobyte-bf3e1085-18b5-4dc5-b949-47389c789044" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-bf3e1085-18b5-4dc5-b949-47389c789044" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623b8b1-7d6c-4769-b239-cd0994bb0464]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:44 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 Apr 21 20:55:44 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:44 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12 Apr 21 20:55:44 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:45 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 1073741824" returned: 0 in 0.638s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00.20c860ff-17d4-4c45-98a8-33b2bea0fc12" returned: 0 in 0.481s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-20c860ff-17d4-4c45-98a8-33b2bea0fc12" released by "_delete_snapshot" :: held 2.283s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-824e46f8-004f-4e0c-8588-f1e05b07df00" released by "delete_snapshot" :: held 2.307s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:45 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 Apr 21 20:55:45 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:45 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044" returned: 0 in 0.621s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Created reservations ['98dd39cd-0e93-4a1d-a36e-a3ba16e4a000', '7c3f7bef-c140-45f2-a3b2-b85271f36eca', '95c90992-26aa-487c-87fb-1aa3e0f4105d', 'fc423c3e-2067-4a7e-8a08-bc5a9e1fbbda'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:45 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044 Apr 21 20:55:45 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Delete snapshot completed successfully. Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bbf1724-c4ce-4f5a-9519-85bad40f3adc tempest-VolumesExtendTest-1245841209 None] Lock "cinder-20c860ff-17d4-4c45-98a8-33b2bea0fc12-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:45 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7" returned: 0 in 0.430s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab32985-c6fe-4b5e-8f88-306cf16314c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c17ae7-c4fb-465d-b158-953c605e3fd7', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e8bcef-22a3-482c-bfd4-39b05297a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Volume volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 (25c17ae7-c4fb-465d-b158-953c605e3fd7): created successfully Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e8bcef-22a3-482c-bfd4-39b05297a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Flow 'volume_create_manager' (bac8654f-3178-483d-b5c0-1fa4ae4558b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a31dd8d7-5104-4c8c-8313-5f59f6fc4ac2 tempest-GroupsTest-1289107507 None] Created volume successfully. Apr 21 20:55:45 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bf3e1085-18b5-4dc5-b949-47389c789044" returned: 0 in 0.456s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-quobyte-bf3e1085-18b5-4dc5-b949-47389c789044" released by "delete_volume" :: held 1.106s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Created reservations ['c2f0495b-01ee-40cc-94de-e18ca96f4dcb', '25a63c1c-3add-456a-a2ad-669713719c0d', '6837efad-280c-4cf4-98ed-c616da3cd446', 'dde0923c-a9f5-4972-822c-f2b7d24c2815'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:45 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:45 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-824e46f8-004f-4e0c-8588-f1e05b07df00-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-824e46f8-004f-4e0c-8588-f1e05b07df00-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "cinder-quobyte-824e46f8-004f-4e0c-8588-f1e05b07df00" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-824e46f8-004f-4e0c-8588-f1e05b07df00" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff62bfc2-2441-4347-904c-801a0164ca7b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:46 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.441s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:46 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Deleted volume successfully. Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-88b98f76-eb61-4c3d-9a53-551fa8aae96d tempest-SnapshotDependencyTests-491832474 None] Lock "cinder-bf3e1085-18b5-4dc5-b949-47389c789044-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:46 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 Apr 21 20:55:46 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:46 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00" returned: 0 in 0.548s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:46 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00 Apr 21 20:55:46 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Acquiring lock "cinder-quobyte-25c17ae7-c4fb-465d-b158-953c605e3fd7" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Lock "cinder-quobyte-25c17ae7-c4fb-465d-b158-953c605e3fd7" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2cf10-5253-406e-b47e-48e51679ad8f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:47 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 Apr 21 20:55:47 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-824e46f8-004f-4e0c-8588-f1e05b07df00" returned: 0 in 0.458s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-quobyte-824e46f8-004f-4e0c-8588-f1e05b07df00" released by "delete_volume" :: held 1.042s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Created reservations ['35443d8b-8529-4c98-b17d-c174a86fc889', '2c542976-3781-40f8-9c30-a1d08e4806e9', '92620379-250f-495b-a898-275ef9892d96', '1337ada3-0396-43ed-a314-a7e9b5046463'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:47 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:47 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7" returned: 0 in 0.593s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:47 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7 Apr 21 20:55:47 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:47 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:47 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Deleted volume successfully. Apr 21 20:55:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c955f5f-800a-41a8-a99a-dec20fe74aa8 tempest-VolumesExtendTest-1245841209 None] Lock "cinder-824e46f8-004f-4e0c-8588-f1e05b07df00-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:48 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-25c17ae7-c4fb-465d-b158-953c605e3fd7" returned: 0 in 0.476s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Lock "cinder-quobyte-25c17ae7-c4fb-465d-b158-953c605e3fd7" released by "delete_volume" :: held 1.100s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Created reservations ['2c5bc24c-daec-4557-a324-c9c455be0567'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:48 devstack cinder-volume[81991]: WARNING cinder.quota [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-976918702 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-976918702, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:48 devstack cinder-volume[81991]: WARNING cinder.quota [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-976918702 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-976918702, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Created reservations ['633097b6-b403-4451-82e0-9c8705e67f92', '2b477d59-65d0-493e-8231-9aca8a6a439d', '8475d121-2766-4fc8-b049-9211335ad06a', '38f8510d-9c01-4b11-b503-dee9163771be'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:48 devstack sudo[87345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:48 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:48 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.449s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:48 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:48 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d9c7dbd4-ee31-4412-89b4-5b6cc904cbaf tempest-GroupsTest-1289107507 None] Delete group completed successfully. Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Created reservations ['1bde2be4-6818-4660-8b94-aaf14632432a'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:49 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:49 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:50 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.778s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:50 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ed977dcb-4a4d-4d5d-b5e4-7362d6c056c2 tempest-GroupsTest-1289107507 None] Delete group completed successfully. Apr 21 20:55:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2bb07492-0421-4bbd-bb55-155467d0e3ca tempest-GroupsTest-1289107507 None] Group tempest-GroupsTest-Group-913923351: creating Apr 21 20:55:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2bb07492-0421-4bbd-bb55-155467d0e3ca tempest-GroupsTest-1289107507 None] Group tempest-GroupsTest-Group-913923351: created successfully Apr 21 20:55:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2bb07492-0421-4bbd-bb55-155467d0e3ca tempest-GroupsTest-1289107507 None] Create group completed successfully. Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:52 devstack sudo[87381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:55:52 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Flow 'volume_create_manager' (7094d8ac-f51d-4d51-b2c2-791622f365be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65d6a11-cf00-49ad-9713-d164fabc82f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65d6a11-cf00-49ad-9713-d164fabc82f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729195180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d583d418-27bc-4f34-a240-03383a06ffcf,host='devstack@QuobyteHD#QuobyteHD',id=9639bc35-9220-4148-8ff4-c91a795ba2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef22de7b698406388a98d02e8fcf19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:53Z,use_quota=True,user_id='d57868e563084475aade0167155aa752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db461ddd-aee9-42a6-a030-c85fb397b6f8),volume_type_id=db461ddd-aee9-42a6-a030-c85fb397b6f8)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63b3b17-3d14-4b16-8fde-dd0682ed7a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63b3b17-3d14-4b16-8fde-dd0682ed7a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7635a447-a85e-4b0f-bed7-7c773651177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7635a447-a85e-4b0f-bed7-7c773651177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9639bc35-9220-4148-8ff4-c91a795ba2cd', 'volume_name': 'volume-9639bc35-9220-4148-8ff4-c91a795ba2cd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283b04a0-9533-4c77-885b-ac98ff4d7270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283b04a0-9533-4c77-885b-ac98ff4d7270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1f0a49-6001-42be-b80a-119960e51f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Volume 9639bc35-9220-4148-8ff4-c91a795ba2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9639bc35-9220-4148-8ff4-c91a795ba2cd', 'volume_size': 1} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d583d418-27bc-4f34-a240-03383a06ffcf,created_at=2026-04-21T18:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729195180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d583d418-27bc-4f34-a240-03383a06ffcf,host='devstack@QuobyteHD#QuobyteHD',id=9639bc35-9220-4148-8ff4-c91a795ba2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef22de7b698406388a98d02e8fcf19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:53Z,use_quota=True,user_id='d57868e563084475aade0167155aa752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db461ddd-aee9-42a6-a030-c85fb397b6f8),volume_type_id=db461ddd-aee9-42a6-a030-c85fb397b6f8)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Creating volume 9639bc35-9220-4148-8ff4-c91a795ba2cd {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:53 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:53 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 1.087s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:55:53 devstack sudo[87384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd 1073741824 Apr 21 20:55:53 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (6fcaaa74-ba2f-48bf-9361-7ccb9905a01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c5f51a-e178-4d83-9733-97f9871980f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c5f51a-e178-4d83-9733-97f9871980f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1280183044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fa96c4-5946-46b1-99f6-e05137674466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:53Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e214180b-f600-4ec6-a23a-d232f40304ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e214180b-f600-4ec6-a23a-d232f40304ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44b96d4-4265-4af2-b9c5-8759e4455b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44b96d4-4265-4af2-b9c5-8759e4455b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fa96c4-5946-46b1-99f6-e05137674466', 'volume_name': 'volume-f6fa96c4-5946-46b1-99f6-e05137674466', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe85709-ee47-4c37-a57c-e8b8746355e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe85709-ee47-4c37-a57c-e8b8746355e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc723f5-aba1-4975-8890-f2dd680931d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Volume f6fa96c4-5946-46b1-99f6-e05137674466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fa96c4-5946-46b1-99f6-e05137674466', 'volume_size': 1} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Flow 'volume_create_manager' (1358642d-4cba-46cd-832b-ad51c9cba226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98adc505-4fc6-422f-b305-30bc52009dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98adc505-4fc6-422f-b305-30bc52009dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1849518877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d15968-134a-4741-a433-4a9e96f6ff7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800b5221825b4b1097a7ed4eff17adbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:53Z,use_quota=True,user_id='694c9bcde5824085bf649273466c6ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912cb972-e771-4f10-b109-fda1598d900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912cb972-e771-4f10-b109-fda1598d900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8a867b-7cf1-4254-8466-8b7e9f6469d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8a867b-7cf1-4254-8466-8b7e9f6469d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d15968-134a-4741-a433-4a9e96f6ff7f', 'volume_name': 'volume-03d15968-134a-4741-a433-4a9e96f6ff7f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767542c4-2e3a-4cf3-88b2-eb736d0af97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767542c4-2e3a-4cf3-88b2-eb736d0af97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e940356d-a551-4de9-ad74-da40e57b7b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:53 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Volume 03d15968-134a-4741-a433-4a9e96f6ff7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d15968-134a-4741-a433-4a9e96f6ff7f', 'volume_size': 1} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:53 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd 1073741824" returned: 0 in 0.750s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:53 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd Apr 21 20:55:53 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd" returned: 0 in 0.479s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1280183044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fa96c4-5946-46b1-99f6-e05137674466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:53Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Creating volume f6fa96c4-5946-46b1-99f6-e05137674466 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:54 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1f0a49-6001-42be-b80a-119960e51f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9639bc35-9220-4148-8ff4-c91a795ba2cd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack sudo[87393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 1073741824 Apr 21 20:55:54 devstack sudo[87393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a8f60-5f21-49ab-9a19-ede2e29e0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:54 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Volume volume-9639bc35-9220-4148-8ff4-c91a795ba2cd (9639bc35-9220-4148-8ff4-c91a795ba2cd): created successfully Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144a8f60-5f21-49ab-9a19-ede2e29e0e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Flow 'volume_create_manager' (7094d8ac-f51d-4d51-b2c2-791622f365be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:54 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-25692358-0da3-4b60-9097-730b5aa1ccc9 tempest-GroupsTest-1289107507 None] Created volume successfully. Apr 21 20:55:54 devstack sudo[87393]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 1073741824" returned: 0 in 0.586s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=164,cinder:INSERT=50,cinder:UPDATE=200,cinder:DELETE=14 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:55:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:54 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 Apr 21 20:55:54 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Flow 'volume_create_manager' (623296bd-828a-403a-b99d-741903f5ef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cb5b76-3649-4018-a3f5-d35f69d175f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cb5b76-3649-4018-a3f5-d35f69d175f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954405037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d583d418-27bc-4f34-a240-03383a06ffcf,host='devstack@QuobyteHD#QuobyteHD',id=88df45bf-09fb-475a-96b6-860f4eff7f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef22de7b698406388a98d02e8fcf19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:55Z,use_quota=True,user_id='d57868e563084475aade0167155aa752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db461ddd-aee9-42a6-a030-c85fb397b6f8),volume_type_id=db461ddd-aee9-42a6-a030-c85fb397b6f8)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b07ecca-44da-4999-bb22-db5421d6dddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b07ecca-44da-4999-bb22-db5421d6dddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cf99ba-253b-4db1-9851-120a4f18924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cf99ba-253b-4db1-9851-120a4f18924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88df45bf-09fb-475a-96b6-860f4eff7f91', 'volume_name': 'volume-88df45bf-09fb-475a-96b6-860f4eff7f91', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738370f7-8a72-4553-be9f-3f9abeb8251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738370f7-8a72-4553-be9f-3f9abeb8251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8573c113-72c7-480c-86b9-f42a0fa9f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:55 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Volume 88df45bf-09fb-475a-96b6-860f4eff7f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88df45bf-09fb-475a-96b6-860f4eff7f91', 'volume_size': 1} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:55 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466" returned: 0 in 0.616s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.025s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1849518877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d15968-134a-4741-a433-4a9e96f6ff7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800b5221825b4b1097a7ed4eff17adbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:53Z,use_quota=True,user_id='694c9bcde5824085bf649273466c6ad9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Creating volume 03d15968-134a-4741-a433-4a9e96f6ff7f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:55 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc723f5-aba1-4975-8890-f2dd680931d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fa96c4-5946-46b1-99f6-e05137674466', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46afcae5-041f-47f1-a464-2911b69f08c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:55 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f 1073741824 Apr 21 20:55:55 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:55 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Volume volume-f6fa96c4-5946-46b1-99f6-e05137674466 (f6fa96c4-5946-46b1-99f6-e05137674466): created successfully Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46afcae5-041f-47f1-a464-2911b69f08c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (6fcaaa74-ba2f-48bf-9361-7ccb9905a01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5552403b-5ac5-4370-a5b9-bb50d744bd8f tempest-VolumesActionsTest-710029045 None] Created volume successfully. Apr 21 20:55:56 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f 1073741824" returned: 0 in 0.503s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f Apr 21 20:55:56 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-75b97783-ee87-4b0c-abca-c6e2303c6a73 tempest-VolumesActionsTest-710029045 None] Acquiring lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466" by "attach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-75b97783-ee87-4b0c-abca-c6e2303c6a73 tempest-VolumesActionsTest-710029045 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466" acquired by "attach_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-75b97783-ee87-4b0c-abca-c6e2303c6a73 tempest-VolumesActionsTest-710029045 None] Attaching volume f6fa96c4-5946-46b1-99f6-e05137674466 to instance 9a9cf510-aa6b-4b1f-af04-41fd82daf903 at mountpoint /dev/vdb on host None. Apr 21 20:55:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-75b97783-ee87-4b0c-abca-c6e2303c6a73 tempest-VolumesActionsTest-710029045 None] Attach volume completed successfully. Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-75b97783-ee87-4b0c-abca-c6e2303c6a73 tempest-VolumesActionsTest-710029045 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466" released by "attach_volume" :: held 0.063s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:56 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f" returned: 0 in 0.426s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d583d418-27bc-4f34-a240-03383a06ffcf,created_at=2026-04-21T18:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-954405037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d583d418-27bc-4f34-a240-03383a06ffcf,host='devstack@QuobyteHD#QuobyteHD',id=88df45bf-09fb-475a-96b6-860f4eff7f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ef22de7b698406388a98d02e8fcf19a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:55:55Z,use_quota=True,user_id='d57868e563084475aade0167155aa752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db461ddd-aee9-42a6-a030-c85fb397b6f8),volume_type_id=db461ddd-aee9-42a6-a030-c85fb397b6f8)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Creating volume 88df45bf-09fb-475a-96b6-860f4eff7f91 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:55:56 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e940356d-a551-4de9-ad74-da40e57b7b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d15968-134a-4741-a433-4a9e96f6ff7f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b628cf07-046d-4a51-b3b6-a6bb42569fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:56 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 1073741824 Apr 21 20:55:56 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:56 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Volume volume-03d15968-134a-4741-a433-4a9e96f6ff7f (03d15968-134a-4741-a433-4a9e96f6ff7f): created successfully Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b628cf07-046d-4a51-b3b6-a6bb42569fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Flow 'volume_create_manager' (1358642d-4cba-46cd-832b-ad51c9cba226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-52c0b281-2fb6-4768-98b0-80370f2e7cb2 tempest-VolumesNegativeTest-1623081330 None] Created volume successfully. Apr 21 20:55:57 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 1073741824" returned: 0 in 0.550s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:57 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 Apr 21 20:55:57 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b4d64eec-5490-4d08-81aa-5d76eecd2338 tempest-VolumesActionsTest-356756533 None] Terminate volume connection completed successfully. Apr 21 20:55:57 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8573c113-72c7-480c-86b9-f42a0fa9f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88df45bf-09fb-475a-96b6-860f4eff7f91', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efeeb2cf-3e77-4d41-aaf1-2b701aecd03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:55:57 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Volume volume-88df45bf-09fb-475a-96b6-860f4eff7f91 (88df45bf-09fb-475a-96b6-860f4eff7f91): created successfully Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efeeb2cf-3e77-4d41-aaf1-2b701aecd03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Flow 'volume_create_manager' (623296bd-828a-403a-b99d-741903f5ef17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:55:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e604b552-0a68-4275-93d9-f7acd5a91682 tempest-GroupsTest-1289107507 None] Created volume successfully. Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b4d64eec-5490-4d08-81aa-5d76eecd2338 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-detach_volume" by "detach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b4d64eec-5490-4d08-81aa-5d76eecd2338 tempest-VolumesActionsTest-356756533 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b4d64eec-5490-4d08-81aa-5d76eecd2338 tempest-VolumesActionsTest-356756533 None] Detaching volume f6fa96c4-5946-46b1-99f6-e05137674466 from instance 9a9cf510-aa6b-4b1f-af04-41fd82daf903. Apr 21 20:55:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b4d64eec-5490-4d08-81aa-5d76eecd2338 tempest-VolumesActionsTest-356756533 None] Detach volume completed successfully. Apr 21 20:55:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b4d64eec-5490-4d08-81aa-5d76eecd2338 tempest-VolumesActionsTest-356756533 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ff55e840-0a4a-494c-8a56-8f5a5a157286 tempest-VolumesActionsTest-710029045 None] Acquiring lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-detach_volume" by "detach_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ff55e840-0a4a-494c-8a56-8f5a5a157286 tempest-VolumesActionsTest-710029045 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ff55e840-0a4a-494c-8a56-8f5a5a157286 tempest-VolumesActionsTest-710029045 None] Volume detach called, but volume not attached. Apr 21 20:55:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ff55e840-0a4a-494c-8a56-8f5a5a157286 tempest-VolumesActionsTest-710029045 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:55:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a280a18c-f116-4057-859f-9060cf1b1964 tempest-GroupsTest-1289107507 None] Update group completed successfully. Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Acquiring lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Acquiring lock "cinder-quobyte-f6fa96c4-5946-46b1-99f6-e05137674466" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Lock "cinder-quobyte-f6fa96c4-5946-46b1-99f6-e05137674466" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aeb0eb-a6d3-410c-acca-0714497a03ba]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 Apr 21 20:55:59 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466" returned: 0 in 0.504s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:55:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:55:59 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466 Apr 21 20:55:59 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:55:59 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-98abbc0e-89a6-415c-98b9-d9c5c7280d4d tempest-GroupsTest-1289107507 None] Update group completed successfully. Apr 21 20:56:00 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6fa96c4-5946-46b1-99f6-e05137674466" returned: 0 in 0.449s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Lock "cinder-quobyte-f6fa96c4-5946-46b1-99f6-e05137674466" released by "delete_volume" :: held 0.974s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Created reservations ['c8093094-12cf-48b4-a644-b99eb81ddd8c', '602d1d98-db5b-4a1d-90d6-f3c78991019a', '080982fb-106a-4458-b2aa-092a3f8b253b', '214ed1b4-fc7c-4baa-8c45-c79a8fc65d01'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:00 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:00 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:00 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.428s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:00 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Deleted volume successfully. Apr 21 20:56:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fb4f07a0-7522-439f-924c-a7ef1f80d078 tempest-VolumesActionsTest-710029045 None] Lock "cinder-f6fa96c4-5946-46b1-99f6-e05137674466-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Acquiring lock "cinder-quobyte-88df45bf-09fb-475a-96b6-860f4eff7f91" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Lock "cinder-quobyte-88df45bf-09fb-475a-96b6-860f4eff7f91" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:01 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed294ac2-a125-4907-8157-009f4540c8e6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 Apr 21 20:56:01 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:01 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91" returned: 0 in 0.525s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:01 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91 Apr 21 20:56:01 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-88df45bf-09fb-475a-96b6-860f4eff7f91" returned: 0 in 0.403s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Lock "cinder-quobyte-88df45bf-09fb-475a-96b6-860f4eff7f91" released by "delete_volume" :: held 0.966s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Acquiring lock "cinder-quobyte-9639bc35-9220-4148-8ff4-c91a795ba2cd" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Lock "cinder-quobyte-9639bc35-9220-4148-8ff4-c91a795ba2cd" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ddc9b-d932-41fd-b058-01c7b49bbdc4]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd Apr 21 20:56:02 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:02 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd" returned: 0 in 0.553s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:02 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd Apr 21 20:56:02 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:03 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9639bc35-9220-4148-8ff4-c91a795ba2cd" returned: 0 in 0.588s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Lock "cinder-quobyte-9639bc35-9220-4148-8ff4-c91a795ba2cd" released by "delete_volume" :: held 1.162s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Created reservations ['4123d1f1-5c81-4766-b433-6205b2f84358'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:03 devstack cinder-volume[81991]: WARNING cinder.quota [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-292050246 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-292050246, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:03 devstack cinder-volume[81991]: WARNING cinder.quota [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-292050246 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-292050246, it is now deprecated. Please use the default quota class for default quota. Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Created reservations ['ee960e38-94e6-4ad4-ad48-af02899a7511', '22139e4a-4901-4595-8b69-f6f6632a97f0', '909dde4f-056e-4986-a02b-ff1e159609e6', '5eb08dc6-cf70-4ccc-9b2b-f82d1b37a881'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Created reservations ['c68de6ad-f0e4-47dc-b36e-d4444cd9a553', '20ccab17-b72b-49df-a66c-c8d24d00d187', '2ece1b69-374a-4400-a406-a2a56729bfc7', 'cf6abb31-91c1-4668-994b-533c3b61a404'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:03 devstack sudo[87487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:03 devstack sudo[87487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:04 devstack sudo[87487]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.513s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:04 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-87fcc4de-3fdb-4b9a-b104-0c8e0c0ac01d tempest-GroupsTest-1289107507 None] Delete group completed successfully. Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (8afcc4c3-a753-4ffa-b39f-2d05d70b82c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b923667-44e6-4740-b58a-9d816a44bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b923667-44e6-4740-b58a-9d816a44bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047197411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60772637-9a93-4c33-879c-f260e4ddb19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:08Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c93d3-73d4-4b5b-a759-8cef6daf8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c93d3-73d4-4b5b-a759-8cef6daf8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0696e7d5-e180-49e1-a7af-a5bcc5ea3a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0696e7d5-e180-49e1-a7af-a5bcc5ea3a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60772637-9a93-4c33-879c-f260e4ddb19c', 'volume_name': 'volume-60772637-9a93-4c33-879c-f260e4ddb19c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4129e8c3-a40d-4665-a94f-de7ed356ad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4129e8c3-a40d-4665-a94f-de7ed356ad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7da738-be87-4347-bc73-b618be82acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Volume 60772637-9a93-4c33-879c-f260e4ddb19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60772637-9a93-4c33-879c-f260e4ddb19c', 'volume_size': 1} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2047197411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60772637-9a93-4c33-879c-f260e4ddb19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:08Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Creating volume 60772637-9a93-4c33-879c-f260e4ddb19c {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:07 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:07 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c 1073741824 Apr 21 20:56:07 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:08 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c 1073741824" returned: 0 in 0.846s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Flow 'volume_create_manager' (7196618e-46d7-4883-9147-27aec7c355ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70e1f6b-3a0a-4d87-8cba-39913565e141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70e1f6b-3a0a-4d87-8cba-39913565e141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-163792733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12203955-e7df-4013-b89e-590c2f6f50de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e07246fee2b43baadc48c61a8cb9888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:09Z,use_quota=True,user_id='e7ced252e024422cbd8480e4f5005c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bd8cce-f67b-461a-9979-f4a791664a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bd8cce-f67b-461a-9979-f4a791664a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4187df89-4ac2-42ec-8776-050cfdebf66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4187df89-4ac2-42ec-8776-050cfdebf66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12203955-e7df-4013-b89e-590c2f6f50de', 'volume_name': 'volume-12203955-e7df-4013-b89e-590c2f6f50de', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9af41fc-59eb-4ce3-915f-ca9597b7fcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9af41fc-59eb-4ce3-915f-ca9597b7fcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88db0225-f773-4149-a98f-bd9fa81ffa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:08 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Volume 12203955-e7df-4013-b89e-590c2f6f50de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12203955-e7df-4013-b89e-590c2f6f50de', 'volume_size': 1} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:08 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c Apr 21 20:56:08 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c" returned: 0 in 0.434s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-163792733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12203955-e7df-4013-b89e-590c2f6f50de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e07246fee2b43baadc48c61a8cb9888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:09Z,use_quota=True,user_id='e7ced252e024422cbd8480e4f5005c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Creating volume 12203955-e7df-4013-b89e-590c2f6f50de {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:09 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7da738-be87-4347-bc73-b618be82acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60772637-9a93-4c33-879c-f260e4ddb19c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de 1073741824 Apr 21 20:56:09 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767a2ed9-ec74-45d6-970f-4168cc7bb809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:09 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Volume volume-60772637-9a93-4c33-879c-f260e4ddb19c (60772637-9a93-4c33-879c-f260e4ddb19c): created successfully Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767a2ed9-ec74-45d6-970f-4168cc7bb809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (8afcc4c3-a753-4ffa-b39f-2d05d70b82c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-654b9c2d-febb-4e22-bb2a-f6a53881a749 tempest-VolumesActionsTest-710029045 None] Created volume successfully. Apr 21 20:56:09 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de 1073741824" returned: 0 in 0.502s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:09 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de Apr 21 20:56:09 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-60772637-9a93-4c33-879c-f260e4ddb19c-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Lock "cinder-60772637-9a93-4c33-879c-f260e4ddb19c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-quobyte-60772637-9a93-4c33-879c-f260e4ddb19c" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-60772637-9a93-4c33-879c-f260e4ddb19c" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e85ad1-bdc4-4a58-b07d-3ce72c421b70]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c Apr 21 20:56:10 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de" returned: 0 in 0.494s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88db0225-f773-4149-a98f-bd9fa81ffa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12203955-e7df-4013-b89e-590c2f6f50de', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2323839d-6ffa-48e4-85a7-a514b0ed454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:10 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Volume volume-12203955-e7df-4013-b89e-590c2f6f50de (12203955-e7df-4013-b89e-590c2f6f50de): created successfully Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2323839d-6ffa-48e4-85a7-a514b0ed454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Flow 'volume_create_manager' (7196618e-46d7-4883-9147-27aec7c355ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-45a7c2b1-fe05-46a1-8aa5-be0445292936 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Created volume successfully. Apr 21 20:56:10 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c" returned: 0 in 0.512s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c Apr 21 20:56:10 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "cinder-12203955-e7df-4013-b89e-590c2f6f50de-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "cinder-12203955-e7df-4013-b89e-590c2f6f50de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "cinder-quobyte-12203955-e7df-4013-b89e-590c2f6f50de" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "cinder-quobyte-12203955-e7df-4013-b89e-590c2f6f50de" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf6bb0a-a45f-45a4-b376-320481305150]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:10 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de Apr 21 20:56:10 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-60772637-9a93-4c33-879c-f260e4ddb19c" returned: 0 in 0.508s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-60772637-9a93-4c33-879c-f260e4ddb19c" released by "delete_volume" :: held 1.047s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Created reservations ['00be621b-d2f1-4ade-a954-f72bd115e44c', 'fc829040-18cf-4a72-bd86-26fb410c71d5', '1cd9a3d9-b04d-4ffb-8512-e3aef9b346dc', '48030ed3-1009-480a-90ca-c57f2433352c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:11 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de" returned: 0 in 0.587s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:11 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de Apr 21 20:56:11 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:11 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.453s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Deleted volume successfully. Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e90a63f-508e-4939-ad6d-4a32f7df67b5 tempest-VolumesActionsTest-356756533 None] Lock "cinder-60772637-9a93-4c33-879c-f260e4ddb19c-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:11 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-12203955-e7df-4013-b89e-590c2f6f50de" returned: 0 in 0.431s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "cinder-quobyte-12203955-e7df-4013-b89e-590c2f6f50de" released by "delete_volume" :: held 1.050s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Created reservations ['e63ca290-7841-4d31-8aae-d223a684a4c7', '48935237-9df8-4ad8-95a9-b2942c0a22fa', '92b3380d-fc22-49ab-ba2d-7acaa9f87f5c', '79d31769-853e-4523-b45d-ccf34fba4a62'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:12 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:12 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.437s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Deleted volume successfully. Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-11ec8805-12ae-4fd5-afb0-3efab9bafa19 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "cinder-12203955-e7df-4013-b89e-590c2f6f50de-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (9b76d388-0bb7-408c-8b58-cc5b864cf73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e33164-de7e-4a10-be3a-cffd668a5568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e33164-de7e-4a10-be3a-cffd668a5568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85096421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8833d400-b85a-4893-a7bf-5c547b4e02f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:13Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b3318b-1868-4d97-9940-efd3137dd5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b3318b-1868-4d97-9940-efd3137dd5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582eeb38-5814-4bbb-b2ff-89d9ea261f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582eeb38-5814-4bbb-b2ff-89d9ea261f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8833d400-b85a-4893-a7bf-5c547b4e02f1', 'volume_name': 'volume-8833d400-b85a-4893-a7bf-5c547b4e02f1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef784b79-fbdc-485c-b840-a86d46a97039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef784b79-fbdc-485c-b840-a86d46a97039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3a50f6-726c-4d3f-86ea-909f02d82647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:12 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Volume 8833d400-b85a-4893-a7bf-5c547b4e02f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8833d400-b85a-4893-a7bf-5c547b4e02f1', 'volume_size': 1} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85096421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8833d400-b85a-4893-a7bf-5c547b4e02f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:13Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Creating volume 8833d400-b85a-4893-a7bf-5c547b4e02f1 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:12 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:12 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 1073741824 Apr 21 20:56:12 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Flow 'volume_create_manager' (e88457c3-18a2-4bf3-9ff1-fdb087e551df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b800aac9-a9a0-4ed1-b97e-51dc0355cd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b800aac9-a9a0-4ed1-b97e-51dc0355cd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1530116645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce3fd03-fd08-4e4d-a6ca-5157549cebfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e07246fee2b43baadc48c61a8cb9888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:13Z,use_quota=True,user_id='e7ced252e024422cbd8480e4f5005c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecc36c9-c0b3-4d24-82a4-fff44176aba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ecc36c9-c0b3-4d24-82a4-fff44176aba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd61a332-805e-4c9b-b397-52693c6d8d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd61a332-805e-4c9b-b397-52693c6d8d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce3fd03-fd08-4e4d-a6ca-5157549cebfd', 'volume_name': 'volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d181c135-8891-4cb4-86bc-350f851c12ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d181c135-8891-4cb4-86bc-350f851c12ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581872ee-0e87-4a63-8110-53d9b47d4222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Volume 8ce3fd03-fd08-4e4d-a6ca-5157549cebfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd', 'volume_size': 1} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:13 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 1073741824" returned: 0 in 0.626s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 Apr 21 20:56:13 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1" returned: 0 in 0.425s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1530116645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce3fd03-fd08-4e4d-a6ca-5157549cebfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e07246fee2b43baadc48c61a8cb9888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:13Z,use_quota=True,user_id='e7ced252e024422cbd8480e4f5005c55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Creating volume 8ce3fd03-fd08-4e4d-a6ca-5157549cebfd {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:13 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3a50f6-726c-4d3f-86ea-909f02d82647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8833d400-b85a-4893-a7bf-5c547b4e02f1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd 1073741824 Apr 21 20:56:13 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9103a37e-8b3d-404d-ba2c-13ed5f922820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:13 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Volume volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 (8833d400-b85a-4893-a7bf-5c547b4e02f1): created successfully Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9103a37e-8b3d-404d-ba2c-13ed5f922820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (9b76d388-0bb7-408c-8b58-cc5b864cf73e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:13 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4a9699f5-8fef-44e3-8257-e6a93e18109f tempest-VolumesActionsTest-710029045 None] Created volume successfully. Apr 21 20:56:14 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd 1073741824" returned: 0 in 0.523s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:14 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd Apr 21 20:56:14 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:14 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd" returned: 0 in 0.432s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581872ee-0e87-4a63-8110-53d9b47d4222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de89b90e-ec26-4b83-a4aa-723317c86c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:14 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Volume volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd (8ce3fd03-fd08-4e4d-a6ca-5157549cebfd): created successfully Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de89b90e-ec26-4b83-a4aa-723317c86c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Flow 'volume_create_manager' (e88457c3-18a2-4bf3-9ff1-fdb087e551df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:14 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-301dd363-3470-48d1-b84c-c277c3acd9c2 tempest-VolumeQuotasAdminTestJSON-1999317248 None] Created volume successfully. Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-8833d400-b85a-4893-a7bf-5c547b4e02f1-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Lock "cinder-8833d400-b85a-4893-a7bf-5c547b4e02f1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-quobyte-8833d400-b85a-4893-a7bf-5c547b4e02f1" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-8833d400-b85a-4893-a7bf-5c547b4e02f1" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce0fe7-00a1-47f5-8ce5-6cd19c8536aa]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:14 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 Apr 21 20:56:14 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1" returned: 0 in 0.466s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1 Apr 21 20:56:15 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-cff80883-b502-4db3-ad28-c342c9348c52 tempest-VolumeQuotasAdminTestJSON-1899867646 None] Transfer volume completed successfully. Apr 21 20:56:15 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8833d400-b85a-4893-a7bf-5c547b4e02f1" returned: 0 in 0.427s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-8833d400-b85a-4893-a7bf-5c547b4e02f1" released by "delete_volume" :: held 0.916s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Created reservations ['c0d47dab-7208-46d4-8d21-1192f5731a1f', 'a7345bed-054e-4621-8478-78ccfc13e7b4', '06d5184d-7625-4d1a-af04-0e402bb84bb6', '27e7b8e2-f9be-4d93-9a79-4b9fdc5d1a8a'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:15 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:15 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (7a6eb2c0-a1cc-49de-8980-408373e78323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a2fcd3-3e46-47a3-bfb9-3fd6f72117e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a2fcd3-3e46-47a3-bfb9-3fd6f72117e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246232221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cd2d41-2ff4-4e89-8cf3-5526458434d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:16Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a0c468-5766-4db7-ae90-3ca883901e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a0c468-5766-4db7-ae90-3ca883901e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b142a4f2-a364-4192-8c04-c52c1e7b6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b142a4f2-a364-4192-8c04-c52c1e7b6e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cd2d41-2ff4-4e89-8cf3-5526458434d2', 'volume_name': 'volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c9ed0-dca1-4e5f-9b1a-58e5e3884aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318c9ed0-dca1-4e5f-9b1a-58e5e3884aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3195dfa6-44f2-4dc6-941b-4237d4ba3d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:16 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Volume 20cd2d41-2ff4-4e89-8cf3-5526458434d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2', 'volume_size': 1} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1246232221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cd2d41-2ff4-4e89-8cf3-5526458434d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:16Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Creating volume 20cd2d41-2ff4-4e89-8cf3-5526458434d2 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:16 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Deleted volume successfully. Apr 21 20:56:16 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 1073741824 Apr 21 20:56:16 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4fce98a0-b63f-4e2e-8833-3fb75de25364 tempest-VolumesActionsTest-356756533 None] Lock "cinder-8833d400-b85a-4893-a7bf-5c547b4e02f1-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Acquiring lock "cinder-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Lock "cinder-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Acquiring lock "cinder-quobyte-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Lock "cinder-quobyte-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baa7aa5-2d2e-43f2-8e08-99dba35bc833]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd Apr 21 20:56:16 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:16 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 1073741824" returned: 0 in 0.510s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:16 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 Apr 21 20:56:16 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd" returned: 0 in 0.498s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd Apr 21 20:56:17 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:17 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2" returned: 0 in 0.411s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3195dfa6-44f2-4dc6-941b-4237d4ba3d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea85419-7a95-4d92-8587-4790f747a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:17 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Volume volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 (20cd2d41-2ff4-4e89-8cf3-5526458434d2): created successfully Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea85419-7a95-4d92-8587-4790f747a38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (7a6eb2c0-a1cc-49de-8980-408373e78323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2c8fcd60-7973-4edd-88dc-916da7dd778f tempest-VolumesActionsTest-710029045 None] Created volume successfully. Apr 21 20:56:17 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd" returned: 0 in 0.458s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Lock "cinder-quobyte-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd" released by "delete_volume" :: held 0.981s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Created reservations ['618b2b0e-11d4-4f0c-83d4-cdc85c3f8943', '6f69e6a8-6e4f-47f2-a0de-0551d24d9e13', 'f418165c-4198-474f-a0f5-1462450be681', '7e13c610-18b5-49fb-b78f-4cf25b140f33'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:17 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:17 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:18 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Deleted volume successfully. Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8bd893c-85d3-40d3-93d8-07f35ec8691e tempest-VolumeQuotasAdminTestJSON-1829542053 None] Lock "cinder-8ce3fd03-fd08-4e4d-a6ca-5157549cebfd-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-20cd2d41-2ff4-4e89-8cf3-5526458434d2-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Lock "cinder-20cd2d41-2ff4-4e89-8cf3-5526458434d2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-quobyte-20cd2d41-2ff4-4e89-8cf3-5526458434d2" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-20cd2d41-2ff4-4e89-8cf3-5526458434d2" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf1eb08-cccd-469b-b9da-d067c3084924]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:18 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 Apr 21 20:56:18 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2" returned: 0 in 0.590s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2 Apr 21 20:56:19 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:19 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-20cd2d41-2ff4-4e89-8cf3-5526458434d2" returned: 0 in 0.520s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-20cd2d41-2ff4-4e89-8cf3-5526458434d2" released by "delete_volume" :: held 1.139s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Created reservations ['4a5310cc-c2e1-4887-9fea-23f484209474', '25cabda2-2493-46d5-a913-6582550d7351', '7b38bd89-266e-4e1f-b4f4-9a9b45fedd3b', '79b3f8e5-bc6d-4327-aa5f-0612cb0151b9'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:19 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:19 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:20 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.439s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:20 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:20 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Deleted volume successfully. Apr 21 20:56:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77fa3943-37e7-4d7b-b0f8-e8e3c74450c7 tempest-VolumesActionsTest-356756533 None] Lock "cinder-20cd2d41-2ff4-4e89-8cf3-5526458434d2-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (9e908007-b5c8-43a3-8d7d-01383514daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78f37fc-021a-4f15-93f5-ad3eebd98628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78f37fc-021a-4f15-93f5-ad3eebd98628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2110182677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfa6e7c-a423-44d1-855a-38ca2ba99f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:21Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1b4c36-99f3-4c2a-b14e-7eb61c6a6406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1b4c36-99f3-4c2a-b14e-7eb61c6a6406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b276ef0-48d8-462a-a72e-668c87d42ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b276ef0-48d8-462a-a72e-668c87d42ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfa6e7c-a423-44d1-855a-38ca2ba99f04', 'volume_name': 'volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60559c1-1f21-4719-9820-f3490e8df0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60559c1-1f21-4719-9820-f3490e8df0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5b16a3-4a94-4712-ad8f-3dd6a8883250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:21 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Volume 5cfa6e7c-a423-44d1-855a-38ca2ba99f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04', 'volume_size': 1} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2110182677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfa6e7c-a423-44d1-855a-38ca2ba99f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:21Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Creating volume 5cfa6e7c-a423-44d1-855a-38ca2ba99f04 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:21 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 1073741824 Apr 21 20:56:21 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:21 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 1073741824" returned: 0 in 0.640s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:21 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 Apr 21 20:56:21 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Acquiring lock "cinder-03d15968-134a-4741-a433-4a9e96f6ff7f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Lock "cinder-03d15968-134a-4741-a433-4a9e96f6ff7f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Acquiring lock "cinder-quobyte-03d15968-134a-4741-a433-4a9e96f6ff7f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Lock "cinder-quobyte-03d15968-134a-4741-a433-4a9e96f6ff7f" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c92fa-adb4-4d34-8bc9-116f8bc044bf]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f Apr 21 20:56:22 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Flow 'volume_create_manager' (8ebc3971-63da-4075-b69a-882d26e97c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:22 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0375798e-7b05-4af0-ac33-b25b11d18a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04" returned: 0 in 0.535s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0375798e-7b05-4af0-ac33-b25b11d18a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1181975356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e83faa7-6d6e-4563-a99d-f5a93b1bff36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9561fb320af4ed18e3c43e66455aad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:22Z,use_quota=True,user_id='ffdd92784d19445786bfec504afd42a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8523ad-45f6-402a-b5c8-bef4a7803c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8523ad-45f6-402a-b5c8-bef4a7803c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75351417-dbdf-477c-b70b-8b8b16cccc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75351417-dbdf-477c-b70b-8b8b16cccc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e83faa7-6d6e-4563-a99d-f5a93b1bff36', 'volume_name': 'volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca244b9b-9676-48b5-8be6-7c8696ef514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca244b9b-9676-48b5-8be6-7c8696ef514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8d4944-6912-402b-b0b9-8ab65056aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Volume 5e83faa7-6d6e-4563-a99d-f5a93b1bff36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36', 'volume_size': 1} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1181975356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e83faa7-6d6e-4563-a99d-f5a93b1bff36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9561fb320af4ed18e3c43e66455aad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:22Z,use_quota=True,user_id='ffdd92784d19445786bfec504afd42a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Creating volume 5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:22 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5b16a3-4a94-4712-ad8f-3dd6a8883250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 1073741824 Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e73bbae-226c-4c96-8f4a-17ecd99dd080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:22 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Volume volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 (5cfa6e7c-a423-44d1-855a-38ca2ba99f04): created successfully Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e73bbae-226c-4c96-8f4a-17ecd99dd080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (9e908007-b5c8-43a3-8d7d-01383514daff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2e5c2d72-1de9-431f-9722-28dd10bdcff6 tempest-VolumesActionsTest-710029045 None] Created volume successfully. Apr 21 20:56:22 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f Apr 21 20:56:22 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 1073741824" returned: 0 in 0.520s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:22 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 Apr 21 20:56:22 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:22 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-03d15968-134a-4741-a433-4a9e96f6ff7f" returned: 0 in 0.421s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Lock "cinder-quobyte-03d15968-134a-4741-a433-4a9e96f6ff7f" released by "delete_volume" :: held 0.946s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:22 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Created reservations ['4b73b45a-65a5-40d5-86ad-576f305952a8', 'ecb0aba7-4287-43e9-9905-a8dfa24267fd', '21dcfc9b-92ea-49c1-9ff9-c2c069f81ba7', 'b41194e5-4da9-4c76-a47f-54ac25483528'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:23 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-5cfa6e7c-a423-44d1-855a-38ca2ba99f04-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Lock "cinder-5cfa6e7c-a423-44d1-855a-38ca2ba99f04-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Acquiring lock "cinder-quobyte-5cfa6e7c-a423-44d1-855a-38ca2ba99f04" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-5cfa6e7c-a423-44d1-855a-38ca2ba99f04" acquired by "delete_volume" :: waited 0.022s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad0b26-0a5a-43b6-962f-07401c673b7a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" returned: 0 in 0.528s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8d4944-6912-402b-b0b9-8ab65056aa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6a3f38-38b0-4c74-ac52-fed0f04a93d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:23 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 Apr 21 20:56:23 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:23 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Volume volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 (5e83faa7-6d6e-4563-a99d-f5a93b1bff36): created successfully Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6a3f38-38b0-4c74-ac52-fed0f04a93d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Flow 'volume_create_manager' (8ebc3971-63da-4075-b69a-882d26e97c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-794a8d7a-34fa-46b6-9742-d895c2516bdb tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Created volume successfully. Apr 21 20:56:23 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.600s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Deleted volume successfully. Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ac80fd47-ee40-43ed-b86c-6302ea999a1e tempest-VolumesNegativeTest-1623081330 None] Lock "cinder-03d15968-134a-4741-a433-4a9e96f6ff7f-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:23 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04" returned: 0 in 0.540s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:23 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04 Apr 21 20:56:23 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5cfa6e7c-a423-44d1-855a-38ca2ba99f04" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Lock "cinder-quobyte-5cfa6e7c-a423-44d1-855a-38ca2ba99f04" released by "delete_volume" :: held 1.031s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Created reservations ['786e7abd-e96f-4678-8590-4dc8893c13b3', '79e4fd7e-ff78-44a3-b77e-d2112a15b44d', '601bc230-27d6-459e-9987-bca460878647', 'ea3c57c7-1627-48d0-9e6a-9e6be7d7d40d'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:24 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Creating offline snapshot dbeb616d-e377-4f4d-971e-9e65dfe07a60 of volume 5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[155318d7-a318-42f4-ad5f-143f25f29377]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:24 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 Apr 21 20:56:24 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Flow 'volume_create_manager' (5582fef0-0ec0-4556-8a3d-94711f67ea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04be073-8e94-4cf9-81bc-9ab8042e847c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04be073-8e94-4cf9-81bc-9ab8042e847c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-412153121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff524cc-41ea-48e8-a046-51a03533f6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f506a15c5ef40e586323e81b579ba1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:25Z,use_quota=True,user_id='43f847c253e74c3aafd7154716eb7dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdaceab-97d5-4d96-a69b-a1debd2da691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdaceab-97d5-4d96-a69b-a1debd2da691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc2e304-babc-4d9d-9305-055c9f6fcdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc2e304-babc-4d9d-9305-055c9f6fcdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff524cc-41ea-48e8-a046-51a03533f6f9', 'volume_name': 'volume-5ff524cc-41ea-48e8-a046-51a03533f6f9', 'volume_size': 2}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dd12db-f1fa-4c2a-bb11-5ab4227a1482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dd12db-f1fa-4c2a-bb11-5ab4227a1482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc0ed38-26e3-4c5f-9e88-1f6c067d41da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:24 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Volume 5ff524cc-41ea-48e8-a046-51a03533f6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff524cc-41ea-48e8-a046-51a03533f6f9', 'volume_size': 2} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:24 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.483s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:24 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Deleted volume successfully. Apr 21 20:56:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ab546318-2abe-4251-9c97-6319f4701fda tempest-VolumesActionsTest-356756533 None] Lock "cinder-5cfa6e7c-a423-44d1-855a-38ca2ba99f04-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:25 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" returned: 0 in 0.522s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 1G Apr 21 20:56:25 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 1G" returned: 0 in 0.492s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:25 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 Apr 21 20:56:25 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (686c27b8-5bc4-4048-a2a1-799598b5b371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c36618-406d-4fd9-a64f-fbb2f4b714df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7c36618-406d-4fd9-a64f-fbb2f4b714df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-892794329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15f2791-bf76-4ba4-8696-7333099442c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:26Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdd63b0-70eb-4226-8ce3-7f57d30ad8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdd63b0-70eb-4226-8ce3-7f57d30ad8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878aec4c-452b-4474-8a7d-942f8dadc71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878aec4c-452b-4474-8a7d-942f8dadc71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15f2791-bf76-4ba4-8696-7333099442c0', 'volume_name': 'volume-a15f2791-bf76-4ba4-8696-7333099442c0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10da71a-62bf-45dd-b1a0-ac81361c0a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10da71a-62bf-45dd-b1a0-ac81361c0a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12c2c89-fd57-490d-9cb9-f19896ca2152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:25 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Volume a15f2791-bf76-4ba4-8696-7333099442c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15f2791-bf76-4ba4-8696-7333099442c0', 'volume_size': 1} Apr 21 20:56:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:26 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60" returned: 0 in 0.430s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 is being set with open permissions: ugo+rw Apr 21 20:56:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 Apr 21 20:56:26 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60" returned: 0 in 0.391s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info Apr 21 20:56:26 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:26 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info" returned: 0 in 0.415s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:26 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info is being set with open permissions: ugo+rw Apr 21 20:56:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:26 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info Apr 21 20:56:26 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:27 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.info" returned: 0 in 0.391s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.433s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-412153121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff524cc-41ea-48e8-a046-51a03533f6f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f506a15c5ef40e586323e81b579ba1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:25Z,use_quota=True,user_id='43f847c253e74c3aafd7154716eb7dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Creating volume 5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:27 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 2147483648 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:27 devstack sudo[87777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 2147483648 Apr 21 20:56:27 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:27 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e54bbf2d-b6ec-4d49-b847-706cfc8693cc tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Create snapshot completed successfully Apr 21 20:56:27 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 2147483648" returned: 0 in 0.550s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:27 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 Apr 21 20:56:27 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "cinder-dbeb616d-e377-4f4d-971e-9e65dfe07a60-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-dbeb616d-e377-4f4d-971e-9e65dfe07a60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "cinder-quobyte-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-quobyte-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "cinder-quobyte-dbeb616d-e377-4f4d-971e-9e65dfe07a60" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-quobyte-dbeb616d-e377-4f4d-971e-9e65dfe07a60" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Deleting offline snapshot dbeb616d-e377-4f4d-971e-9e65dfe07a60 of volume 5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] snapshot_file for this snap is: volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48ebd1-35bf-422b-aeb0-e66c6597e9fc]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 Apr 21 20:56:28 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9" returned: 0 in 0.422s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-892794329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15f2791-bf76-4ba4-8696-7333099442c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dd3462afbc84e828cdb045fdd0c9bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:26Z,use_quota=True,user_id='fc84137ce44a49a190f0e5bb46f977b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Creating volume a15f2791-bf76-4ba4-8696-7333099442c0 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:28 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc0ed38-26e3-4c5f-9e88-1f6c067d41da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff524cc-41ea-48e8-a046-51a03533f6f9', 'volume_size': 2}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a45f11-2c68-4982-80b9-e3ba93a637a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:28 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 1073741824 Apr 21 20:56:28 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Volume volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 (5ff524cc-41ea-48e8-a046-51a03533f6f9): created successfully Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a45f11-2c68-4982-80b9-e3ba93a637a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Flow 'volume_create_manager' (5582fef0-0ec0-4556-8a3d-94711f67ea4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:28 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-eae1be66-193e-4a60-bc6e-b115cda00a9f tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Created volume successfully. Apr 21 20:56:28 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[483a94c3-99c3-40f8-b6b9-63a0a35b7a4e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[87792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 Apr 21 20:56:28 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:28 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 1073741824" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:28 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 Apr 21 20:56:28 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" returned: 0 in 0.543s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 Apr 21 20:56:29 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:29 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0" returned: 0 in 0.430s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.073s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12c2c89-fd57-490d-9cb9-f19896ca2152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15f2791-bf76-4ba4-8696-7333099442c0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30c198-85f2-4118-af63-4f2742808122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Creating offline snapshot fc1b4120-090c-471a-88c2-103ff1307fcb of volume 5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:29 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Volume volume-a15f2791-bf76-4ba4-8696-7333099442c0 (a15f2791-bf76-4ba4-8696-7333099442c0): created successfully Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30c198-85f2-4118-af63-4f2742808122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Flow 'volume_create_manager' (686c27b8-5bc4-4048-a2a1-799598b5b371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6323da40-7fee-4398-a588-ba025bfa87d0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1f1e92b7-c18f-47b3-921e-8cfccc4492a0 tempest-VolumesActionsTest-710029045 None] Created volume successfully. Apr 21 20:56:29 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 Apr 21 20:56:29 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60" returned: 0 in 0.462s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60 Apr 21 20:56:29 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9" returned: 0 in 0.484s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb 2G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:29 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb 2G Apr 21 20:56:29 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:29 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36.dbeb616d-e377-4f4d-971e-9e65dfe07a60" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-quobyte-dbeb616d-e377-4f4d-971e-9e65dfe07a60" released by "_delete_snapshot" :: held 1.947s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-quobyte-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" released by "delete_snapshot" :: held 1.959s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Created reservations ['def36444-bd27-4d49-9d0e-c033c31e7b05', '8bfa49cf-fcf0-4477-a4af-542c7dde1330', '2673512d-98fc-4075-82a6-87d42f880b47', '3efdc4ea-3e7e-41f9-b05e-062e847ba7d7'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:30 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Delete snapshot completed successfully. Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ce99742-3178-47f3-8fae-adef5b957368 tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-dbeb616d-e377-4f4d-971e-9e65dfe07a60-delete_snapshot" released by "delete_snapshot" :: held 2.058s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "cinder-5e83faa7-6d6e-4563-a99d-f5a93b1bff36-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-5e83faa7-6d6e-4563-a99d-f5a93b1bff36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "cinder-quobyte-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-quobyte-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" acquired by "delete_volume" :: waited 0.020s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc432c-6358-4a6b-a022-3d1bc26e12a9]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 Apr 21 20:56:30 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb 2G" returned: 0 in 0.593s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb Apr 21 20:56:30 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Acquiring lock "cinder-a15f2791-bf76-4ba4-8696-7333099442c0-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Lock "cinder-a15f2791-bf76-4ba4-8696-7333099442c0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Acquiring lock "cinder-quobyte-a15f2791-bf76-4ba4-8696-7333099442c0" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Lock "cinder-quobyte-a15f2791-bf76-4ba4-8696-7333099442c0" acquired by "delete_volume" :: waited 0.006s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec6458-b993-4fc4-b5bb-f1bf624d1070]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 Apr 21 20:56:30 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" returned: 0 in 0.518s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36 Apr 21 20:56:30 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb is being set with open permissions: ugo+rw Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:30 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb Apr 21 20:56:30 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:30 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0 Apr 21 20:56:31 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" returned: 0 in 0.422s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-quobyte-5e83faa7-6d6e-4563-a99d-f5a93b1bff36" released by "delete_volume" :: held 0.975s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:31 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb" returned: 0 in 0.431s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Created reservations ['f3a0d4ff-c749-45df-bffb-371548610580', '65c6e98f-86e7-4401-ace4-e7987fc43184', 'fdc4b408-a5f4-4140-afef-01a87ec5779c', '783e24ce-b3dd-4a63-9fb8-57e49ae24153'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info Apr 21 20:56:31 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:31 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a15f2791-bf76-4ba4-8696-7333099442c0" returned: 0 in 0.437s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Lock "cinder-quobyte-a15f2791-bf76-4ba4-8696-7333099442c0" released by "delete_volume" :: held 0.953s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Created reservations ['ca0bfec8-593c-4182-8078-dfa82498be5a', 'a04ea682-e40d-418f-a6dc-638f4c55ba91', 'f9741d7d-5bc2-491c-af14-cbf2d5f01a66', '435f9124-5049-48fb-96e1-c051a742c7f9'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:31 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info is being set with open permissions: ugo+rw Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:31 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info Apr 21 20:56:31 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:31 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.469s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Deleted volume successfully. Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-368c0bad-f89f-4557-b97c-81c3469d00fa tempest-VolumeSnapshotQuotasNegativeTestJSON-1015947192 None] Lock "cinder-5e83faa7-6d6e-4563-a99d-f5a93b1bff36-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:31 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.408s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Deleted volume successfully. Apr 21 20:56:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-83150a29-ec05-4dcf-a62a-4bcee2193a1e tempest-VolumesActionsTest-710029045 None] Lock "cinder-a15f2791-bf76-4ba4-8696-7333099442c0-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:32 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.info" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:32 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d5aebfb9-cb86-4d04-9004-60bbdb0c21c7 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Create snapshot completed successfully Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "cinder-fc1b4120-090c-471a-88c2-103ff1307fcb-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-fc1b4120-090c-471a-88c2-103ff1307fcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "cinder-quobyte-5ff524cc-41ea-48e8-a046-51a03533f6f9" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-quobyte-5ff524cc-41ea-48e8-a046-51a03533f6f9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "cinder-quobyte-fc1b4120-090c-471a-88c2-103ff1307fcb" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-quobyte-fc1b4120-090c-471a-88c2-103ff1307fcb" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Deleting offline snapshot fc1b4120-090c-471a-88c2-103ff1307fcb of volume 5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] snapshot_file for this snap is: volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd095ba9-e097-4376-9894-1ddcf103a2bf]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:33 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb Apr 21 20:56:33 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:34 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb" returned: 0 in 0.763s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ff524cc-41ea-48e8-a046-51a03533f6f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:34 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e98414-9e53-4c81-80b8-2641ffc47f3b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 Apr 21 20:56:34 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:34 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9" returned: 0 in 0.589s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:34 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb Apr 21 20:56:34 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb Apr 21 20:56:35 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9.fc1b4120-090c-471a-88c2-103ff1307fcb" returned: 0 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Flow 'volume_create_manager' (209a705f-e54c-448a-9efe-7d06fb0c21c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa49beb-be7d-43b5-8c61-c7eeabb4cc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fa49beb-be7d-43b5-8c61-c7eeabb4cc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-924639950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb2e960-5426-4e29-927a-4e7a86295db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02d2088f6df49daa8e5550e595539f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:36Z,use_quota=True,user_id='aac3ccee734a4e5abbd981aaeddce22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aab99f3-746c-48b6-b076-5deb6319f8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aab99f3-746c-48b6-b076-5deb6319f8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004d58b3-684a-4345-b998-6cd44beef179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004d58b3-684a-4345-b998-6cd44beef179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cb2e960-5426-4e29-927a-4e7a86295db5', 'volume_name': 'volume-1cb2e960-5426-4e29-927a-4e7a86295db5', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055145f6-e5f9-4413-8c73-82e326171681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (055145f6-e5f9-4413-8c73-82e326171681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4db44e3-c154-41dc-a6d2-484171ed6333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:35 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Volume 1cb2e960-5426-4e29-927a-4e7a86295db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cb2e960-5426-4e29-927a-4e7a86295db5', 'volume_size': 1} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-924639950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cb2e960-5426-4e29-927a-4e7a86295db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02d2088f6df49daa8e5550e595539f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:36Z,use_quota=True,user_id='aac3ccee734a4e5abbd981aaeddce22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Creating volume 1cb2e960-5426-4e29-927a-4e7a86295db5 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:35 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:35 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 1073741824 Apr 21 20:56:35 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-quobyte-fc1b4120-090c-471a-88c2-103ff1307fcb" released by "_delete_snapshot" :: held 2.559s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-quobyte-5ff524cc-41ea-48e8-a046-51a03533f6f9" released by "delete_snapshot" :: held 2.572s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Created reservations ['9b1d3810-10ee-4e20-b868-8434e57109f0', '536219f3-a266-42b9-99c9-20a9fcd426ef', '2600c857-d9c3-4275-99c0-2d7d1c5ac478', 'eaba3a0b-ab13-4deb-82e6-2f10f416474b'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:36 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Delete snapshot completed successfully. Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ba9f821-0d96-4586-865d-d867d59ebeb1 tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-fc1b4120-090c-471a-88c2-103ff1307fcb-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:36 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 1073741824" returned: 0 in 0.572s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 Apr 21 20:56:36 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "cinder-5ff524cc-41ea-48e8-a046-51a03533f6f9-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-5ff524cc-41ea-48e8-a046-51a03533f6f9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "cinder-quobyte-5ff524cc-41ea-48e8-a046-51a03533f6f9" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-quobyte-5ff524cc-41ea-48e8-a046-51a03533f6f9" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa58e23-fd88-4675-83b6-96c56a893883]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:36 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 Apr 21 20:56:36 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:37 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4db44e3-c154-41dc-a6d2-484171ed6333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cb2e960-5426-4e29-927a-4e7a86295db5', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6b3230-2a04-4cb9-a301-28ea02e4089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:37 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Volume volume-1cb2e960-5426-4e29-927a-4e7a86295db5 (1cb2e960-5426-4e29-927a-4e7a86295db5): created successfully Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6b3230-2a04-4cb9-a301-28ea02e4089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Flow 'volume_create_manager' (209a705f-e54c-448a-9efe-7d06fb0c21c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ff786d91-7c2f-43f5-b82c-bcf6520940d8 tempest-VolumesListAdminTestJSON-1835513151 None] Created volume successfully. Apr 21 20:56:37 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9" returned: 0 in 0.543s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9 Apr 21 20:56:37 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:37 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5ff524cc-41ea-48e8-a046-51a03533f6f9" returned: 0 in 0.438s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-quobyte-5ff524cc-41ea-48e8-a046-51a03533f6f9" released by "delete_volume" :: held 1.020s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Created reservations ['6a426d91-136c-4ff2-a021-c395e4b1e429', 'f76cba89-bf76-4a21-ab44-0c839a1104ad', 'e1a8231d-1695-46e3-9f85-9d2a23b9c0aa', 'fa1309fd-25d9-4737-995a-fe7fb788cd8f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:37 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:37 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Flow 'volume_create_manager' (a9570e8a-0a2c-4ff5-a0f2-d7106c73e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab3d047-0cd5-4b3c-a82b-57e7af14b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab3d047-0cd5-4b3c-a82b-57e7af14b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-274833402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814c115e-a2d7-4799-b2f8-ab5f12e9d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02d2088f6df49daa8e5550e595539f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:38Z,use_quota=True,user_id='aac3ccee734a4e5abbd981aaeddce22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8344f99a-b850-4323-8c59-4671155f4e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8344f99a-b850-4323-8c59-4671155f4e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fffe5f-aecc-4870-bf73-18748a7f39bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80fffe5f-aecc-4870-bf73-18748a7f39bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814c115e-a2d7-4799-b2f8-ab5f12e9d4a9', 'volume_name': 'volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc0f234-cb87-4ab3-ba0a-2d1bc9adf509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bc0f234-cb87-4ab3-ba0a-2d1bc9adf509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31b45d0-b39e-415b-b463-34a22cf58d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:38 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Volume 814c115e-a2d7-4799-b2f8-ab5f12e9d4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9', 'volume_size': 1} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-274833402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814c115e-a2d7-4799-b2f8-ab5f12e9d4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02d2088f6df49daa8e5550e595539f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:38Z,use_quota=True,user_id='aac3ccee734a4e5abbd981aaeddce22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Creating volume 814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:38 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.530s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:38 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Deleted volume successfully. Apr 21 20:56:38 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 1073741824 Apr 21 20:56:38 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ca195f7-7b6e-45b5-9c08-9c19bef26fef tempest-VolumesSnapshotNegativeTestJSON-402189411 None] Lock "cinder-5ff524cc-41ea-48e8-a046-51a03533f6f9-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:38 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 1073741824" returned: 0 in 0.558s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:38 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 Apr 21 20:56:38 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Flow 'volume_create_manager' (98a4164d-03a1-4805-8e70-4e694112c4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec644ad-96e3-421c-b838-7502ffd9a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec644ad-96e3-421c-b838-7502ffd9a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1758071998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490e59e1-12d2-40a8-a336-03a52a9ce1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70acbc85baf7473d9523dfe70a4ec8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:39Z,use_quota=True,user_id='b5169b73a61349938f2f3386543a1f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1513d2c3-d085-4e78-8797-de7fa508969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1513d2c3-d085-4e78-8797-de7fa508969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e035a58-30d0-4314-8aa9-a57f8a493c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.image.glance [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Creating Keystone auth plugin from conf {{(pid=81991) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:56:39 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31b45d0-b39e-415b-b463-34a22cf58d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1484ce-dd85-4fc0-89e4-b69adffd41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Volume volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 (814c115e-a2d7-4799-b2f8-ab5f12e9d4a9): created successfully Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1484ce-dd85-4fc0-89e4-b69adffd41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Flow 'volume_create_manager' (a9570e8a-0a2c-4ff5-a0f2-d7106c73e71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:39 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-70b34a97-1769-4234-84b9-22ced9e44cb8 tempest-VolumesListAdminTestJSON-1835513151 None] Created volume successfully. Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e035a58-30d0-4314-8aa9-a57f8a493c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '490e59e1-12d2-40a8-a336-03a52a9ce1bd', 'volume_name': 'volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d97035-45f7-460e-b9f0-45739d3f523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d97035-45f7-460e-b9f0-45739d3f523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f07ccb5-b71c-48d4-85ef-75eb070b1083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:39 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Volume 490e59e1-12d2-40a8-a336-03a52a9ce1bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Trying to clone 490e59e1-12d2-40a8-a336-03a52a9ce1bd from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]). {{(pid=81991) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:56:39 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada18e15-5377-4d27-8384-080da0f7def8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:39 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD Apr 21 20:56:39 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 is fetched for user b5169b73a61349938f2f3386543a1f07. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2edbfb-b522-4ece-993b-f2a0ddf88639]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:40 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD Apr 21 20:56:40 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Flow 'volume_create_manager' (ce8fa5bd-6f73-416a-b6f1-33da06db2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a578747a-53ee-4d83-930f-e5b9a1d79c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a578747a-53ee-4d83-930f-e5b9a1d79c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-953598563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589919b4-b683-4b7c-8ac0-c6f35ef33f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02d2088f6df49daa8e5550e595539f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='aac3ccee734a4e5abbd981aaeddce22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8b6d86-6610-4990-872b-d3814c49fb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8b6d86-6610-4990-872b-d3814c49fb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a50ce5-7278-41a5-b75f-267f8bc687ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a50ce5-7278-41a5-b75f-267f8bc687ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589919b4-b683-4b7c-8ac0-c6f35ef33f87', 'volume_name': 'volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d21bd44-c662-47f6-9c82-e5ed439c206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d21bd44-c662-47f6-9c82-e5ed439c206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79002213-7b2f-4591-ab5c-1c0ab5e39b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Volume 589919b4-b683-4b7c-8ac0-c6f35ef33f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87', 'volume_size': 1} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-953598563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589919b4-b683-4b7c-8ac0-c6f35ef33f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02d2088f6df49daa8e5550e595539f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='aac3ccee734a4e5abbd981aaeddce22e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Creating volume 589919b4-b683-4b7c-8ac0-c6f35ef33f87 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:40 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:40 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 1073741824 Apr 21 20:56:40 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:40 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (3039c652-1534-4354-b49f-fd355461584b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cafa9d-c545-4a53-926c-1362321e8b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cafa9d-c545-4a53-926c-1362321e8b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2071359030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc2c46d-6444-4dc8-9644-c5c8caaff47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0febf08c-f60b-41cd-b824-63f9a4f7dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0febf08c-f60b-41cd-b824-63f9a4f7dff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4147b7cb-544e-497f-92c3-bde4c13d3984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4147b7cb-544e-497f-92c3-bde4c13d3984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc2c46d-6444-4dc8-9644-c5c8caaff47d', 'volume_name': 'volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5843478-58a3-4e23-9d6d-7df2ba1dfb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5843478-58a3-4e23-9d6d-7df2ba1dfb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3250174d-779d-4db5-9b53-6348b03c461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:40 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Volume 9fc2c46d-6444-4dc8-9644-c5c8caaff47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d', 'volume_size': 1} Apr 21 20:56:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (045f98e2-ce51-487a-bf4b-236d4e4fb504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a4dd96-87bd-4956-a5c6-9b11860c8906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a4dd96-87bd-4956-a5c6-9b11860c8906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024853504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad133271-a6e4-4be9-b712-2de1841f29f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd56c4df-a1fa-4cf8-990d-98a08906bf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd56c4df-a1fa-4cf8-990d-98a08906bf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a859055-0d35-4b21-ba80-aefe70a57497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a859055-0d35-4b21-ba80-aefe70a57497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad133271-a6e4-4be9-b712-2de1841f29f1', 'volume_name': 'volume-ad133271-a6e4-4be9-b712-2de1841f29f1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80920a91-527e-434f-87d5-ab5b899666a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80920a91-527e-434f-87d5-ab5b899666a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df0f344-64eb-493c-b834-aaf32d93290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Volume ad133271-a6e4-4be9-b712-2de1841f29f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad133271-a6e4-4be9-b712-2de1841f29f1', 'volume_size': 1} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (09e30e02-a953-45d1-9a68-3db30d475a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310b37e0-00ac-42fe-8bb6-f8c84b1b6d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310b37e0-00ac-42fe-8bb6-f8c84b1b6d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969037856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dd1fdb-1f15-4fe4-b079-41256e245513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdd880f-d0a4-47fd-8f79-173e1f0244cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdd880f-d0a4-47fd-8f79-173e1f0244cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b972554d-6142-4ab7-8dba-ada9ae01e1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b972554d-6142-4ab7-8dba-ada9ae01e1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dd1fdb-1f15-4fe4-b079-41256e245513', 'volume_name': 'volume-73dd1fdb-1f15-4fe4-b079-41256e245513', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90bf34f-d6af-40c1-bde4-f2fdd4a3ba7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90bf34f-d6af-40c1-bde4-f2fdd4a3ba7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db30f00-b9e6-4650-9de7-4e00039c7005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Volume 73dd1fdb-1f15-4fe4-b079-41256e245513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dd1fdb-1f15-4fe4-b079-41256e245513', 'volume_size': 1} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 1073741824" returned: 0 in 0.564s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 Apr 21 20:56:41 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (df39264f-8f34-4bea-8b21-88b33a9cb093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8838e1-abf2-439c-8fb6-d91116fba69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8838e1-abf2-439c-8fb6-d91116fba69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856466765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7dee38-a733-4df6-9f3d-b972da402247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5f44b6-b2dc-464f-ab57-713de87d2c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5f44b6-b2dc-464f-ab57-713de87d2c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45d3431-78ab-4408-a6e6-7d180d63c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45d3431-78ab-4408-a6e6-7d180d63c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7dee38-a733-4df6-9f3d-b972da402247', 'volume_name': 'volume-7a7dee38-a733-4df6-9f3d-b972da402247', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ec5794-8cbd-45ac-ab3e-c1dbbb68e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ec5794-8cbd-45ac-ab3e-c1dbbb68e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb9dd9-fbf3-4b3a-9ecf-5563a21f46eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Volume 7a7dee38-a733-4df6-9f3d-b972da402247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7dee38-a733-4df6-9f3d-b972da402247', 'volume_size': 1} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (05ea0d8a-2304-4c6f-af12-8cf47022e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9a87d9-ea71-4558-b798-88c08b64573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9a87d9-ea71-4558-b798-88c08b64573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2116117585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649f89c7-a48a-4bd2-903d-d8e66eb8824c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:42Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76faaba9-a044-452c-92dd-9e77d2b02b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76faaba9-a044-452c-92dd-9e77d2b02b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9fa167-d28d-4460-a908-9fb2541d1aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b9fa167-d28d-4460-a908-9fb2541d1aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649f89c7-a48a-4bd2-903d-d8e66eb8824c', 'volume_name': 'volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7116e4-c4d1-400b-ad9f-4969b80f1981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7116e4-c4d1-400b-ad9f-4969b80f1981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2730d4-19b9-47cd-955c-0196e45afcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Volume 649f89c7-a48a-4bd2-903d-d8e66eb8824c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c', 'volume_size': 1} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1758071998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=490e59e1-12d2-40a8-a336-03a52a9ce1bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70acbc85baf7473d9523dfe70a4ec8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:39Z,use_quota=True,user_id='b5169b73a61349938f2f3386543a1f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Creating volume 490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79002213-7b2f-4591-ab5c-1c0ab5e39b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd 1073741824 Apr 21 20:56:41 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d75c44a-f85c-427b-b88f-5a35306cbd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Volume volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 (589919b4-b683-4b7c-8ac0-c6f35ef33f87): created successfully Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d75c44a-f85c-427b-b88f-5a35306cbd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Flow 'volume_create_manager' (ce8fa5bd-6f73-416a-b6f1-33da06db2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-712ed70e-9a93-410e-9f62-2f012a73329a tempest-VolumesListAdminTestJSON-1835513151 None] Created volume successfully. Apr 21 20:56:42 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd 1073741824" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:42 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:42 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 0 in 0.421s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2071359030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc2c46d-6444-4dc8-9644-c5c8caaff47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Creating volume 9fc2c46d-6444-4dc8-9644-c5c8caaff47d {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:42 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d 1073741824 Apr 21 20:56:42 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Attempting download of 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume 490e59e1-12d2-40a8-a336-03a52a9ce1bd. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8ee8b-ea7e-4f72-999d-1722139a461f]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:42 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo Apr 21 20:56:42 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Flow 'volume_create_manager' (ada0d358-bd79-498b-a674-74b54fe94aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2efde7-858c-441b-95f8-5d5575b91934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2efde7-858c-441b-95f8-5d5575b91934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308c06ab-07cd-43f1-a0df-ac4117162d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3082913d6ebd41a4912c031d12f87f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:43Z,use_quota=True,user_id='a74ef53ca21147e1a02679510849201e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84af3ad-644b-49d1-9e18-d8c96f1a4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84af3ad-644b-49d1-9e18-d8c96f1a4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c49bba4-16fc-4bcf-b72c-2bb2777a4dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c49bba4-16fc-4bcf-b72c-2bb2777a4dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308c06ab-07cd-43f1-a0df-ac4117162d22', 'volume_name': 'volume-308c06ab-07cd-43f1-a0df-ac4117162d22', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777b767f-8483-47ae-b38d-c8d0b193aa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777b767f-8483-47ae-b38d-c8d0b193aa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20c82f4-c36a-4c24-9fcd-9992b81fd701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Volume 308c06ab-07cd-43f1-a0df-ac4117162d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308c06ab-07cd-43f1-a0df-ac4117162d22', 'volume_size': 1} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:43 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d 1073741824" returned: 0 in 0.553s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=174,cinder:INSERT=60,cinder:UPDATE=226,cinder:DELETE=14 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo" returned: 0 in 0.524s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo Apr 21 20:56:43 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d" returned: 0 in 0.416s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.697s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024853504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad133271-a6e4-4be9-b712-2de1841f29f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Creating volume ad133271-a6e4-4be9-b712-2de1841f29f1 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:43 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3250174d-779d-4db5-9b53-6348b03c461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 1073741824 Apr 21 20:56:43 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a69523-3c15-4bd0-937c-d4376256591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:43 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Volume volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d (9fc2c46d-6444-4dc8-9644-c5c8caaff47d): created successfully Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a69523-3c15-4bd0-937c-d4376256591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (3039c652-1534-4354-b49f-fd355461584b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-931a1a33-2b37-412b-8df5-0cea41983cb0 tempest-CreateVolumesFromImageTest-1247022421 None] Created volume successfully. Apr 21 20:56:43 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo" returned: 1 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wbgb7rlo' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be25b89-ec7b-4f10-ae57-ce5a8e35f213]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:43 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD Apr 21 20:56:43 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 1073741824" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 was qcow2, converting to raw {{(pid=81991) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:56:44 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 Apr 21 20:56:44 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:44 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1" returned: 0 in 0.411s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.423s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969037856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dd1fdb-1f15-4fe4-b079-41256e245513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Creating volume 73dd1fdb-1f15-4fe4-b079-41256e245513 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:44 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df0f344-64eb-493c-b834-aaf32d93290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad133271-a6e4-4be9-b712-2de1841f29f1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 1073741824 Apr 21 20:56:44 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a578c637-4d99-4b4d-bf18-de8b72cef1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Volume volume-ad133271-a6e4-4be9-b712-2de1841f29f1 (ad133271-a6e4-4be9-b712-2de1841f29f1): created successfully Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a578c637-4d99-4b4d-bf18-de8b72cef1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (045f98e2-ce51-487a-bf4b-236d4e4fb504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4b62ac99-7084-41ab-925c-23c0503d4f9f tempest-CreateVolumesFromImageTest-1247022421 None] Created volume successfully. Apr 21 20:56:45 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 0 in 0.884s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_wy57np1hdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:56:45 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Converted 112.00 MB image at 112.00 MB/s Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd 1G Apr 21 20:56:45 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 1073741824" returned: 0 in 0.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 Apr 21 20:56:45 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd 1G" returned: 0 in 0.409s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac3a092-ed76-4bfa-bcaa-b46186c0e38c]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513" returned: 0 in 0.409s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.180s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1856466765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7dee38-a733-4df6-9f3d-b972da402247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:41Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Creating volume 7a7dee38-a733-4df6-9f3d-b972da402247 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:45 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:45 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:45 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:45 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 1073741824 Apr 21 20:56:45 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db30f00-b9e6-4650-9de7-4e00039c7005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dd1fdb-1f15-4fe4-b079-41256e245513', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830f491f-57b4-4890-b2d6-1c7859035aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Volume volume-73dd1fdb-1f15-4fe4-b079-41256e245513 (73dd1fdb-1f15-4fe4-b079-41256e245513): created successfully Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830f491f-57b4-4890-b2d6-1c7859035aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (09e30e02-a953-45d1-9a68-3db30d475a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-24e54c8d-5b24-4d91-b756-d1a9542a65e3 tempest-CreateVolumesFromImageTest-1247022421 None] Created volume successfully. Apr 21 20:56:46 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 0 in 0.500s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 1073741824" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 Apr 21 20:56:46 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 1 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Downloaded image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume 490e59e1-12d2-40a8-a336-03a52a9ce1bd successfully. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 for user b5169b73a61349938f2f3386543a1f07 is deleted. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Marking volume 490e59e1-12d2-40a8-a336-03a52a9ce1bd as bootable. {{(pid=81991) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:56:46 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247" returned: 0 in 0.435s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.949s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2116117585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649f89c7-a48a-4bd2-903d-d8e66eb8824c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61441634b63c4782b00c7852e8aa7be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:42Z,use_quota=True,user_id='c653b0af0ace494085c1ae7ddef3e193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Creating volume 649f89c7-a48a-4bd2-903d-d8e66eb8824c {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:46 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Copying metadata from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 to 490e59e1-12d2-40a8-a336-03a52a9ce1bd. {{(pid=81991) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Creating volume glance metadata for volume 490e59e1-12d2-40a8-a336-03a52a9ce1bd backed by image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81991) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:56:46 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c 1073741824 Apr 21 20:56:46 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb9dd9-fbf3-4b3a-9ecf-5563a21f46eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7dee38-a733-4df6-9f3d-b972da402247', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b03afc0-fb81-416b-afb5-581261ceffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Volume volume-7a7dee38-a733-4df6-9f3d-b972da402247 (7a7dee38-a733-4df6-9f3d-b972da402247): created successfully Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b03afc0-fb81-416b-afb5-581261ceffa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (df39264f-8f34-4bea-8b21-88b33a9cb093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:46 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f9023d81-8cee-49dc-82c0-4d6468c8ac69 tempest-CreateVolumesFromImageTest-1247022421 None] Created volume successfully. Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f07ccb5-b71c-48d4-85ef-75eb070b1083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55472b34-4ff6-4b1d-8185-948b9843415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:46 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Volume volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd (490e59e1-12d2-40a8-a336-03a52a9ce1bd): created successfully Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55472b34-4ff6-4b1d-8185-948b9843415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:46 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Flow 'volume_create_manager' (98a4164d-03a1-4805-8e70-4e694112c4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:46 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-04c54b0a-944a-4e16-ac06-e53041e58c94 tempest-VolumesImageMetadata-1841832491 None] Created volume successfully. Apr 21 20:56:47 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c 1073741824" returned: 0 in 0.496s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c Apr 21 20:56:47 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c" returned: 0 in 0.426s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.368s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308c06ab-07cd-43f1-a0df-ac4117162d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3082913d6ebd41a4912c031d12f87f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:43Z,use_quota=True,user_id='a74ef53ca21147e1a02679510849201e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Creating volume 308c06ab-07cd-43f1-a0df-ac4117162d22 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:47 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2730d4-19b9-47cd-955c-0196e45afcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 1073741824 Apr 21 20:56:47 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006d703a-b80a-492b-8f0e-61533414d50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Volume volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c (649f89c7-a48a-4bd2-903d-d8e66eb8824c): created successfully Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006d703a-b80a-492b-8f0e-61533414d50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Flow 'volume_create_manager' (05ea0d8a-2304-4c6f-af12-8cf47022e895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:47 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b28ce241-f317-4556-a149-0d67b341d8ee tempest-CreateVolumesFromImageTest-1247022421 None] Created volume successfully. Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Acquiring lock "cinder-490e59e1-12d2-40a8-a336-03a52a9ce1bd-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Lock "cinder-490e59e1-12d2-40a8-a336-03a52a9ce1bd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Acquiring lock "cinder-quobyte-490e59e1-12d2-40a8-a336-03a52a9ce1bd" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Lock "cinder-quobyte-490e59e1-12d2-40a8-a336-03a52a9ce1bd" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeece9a-1460-4099-9b45-5a8753487de1]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:47 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:47 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 1073741824" returned: 0 in 0.569s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-649f89c7-a48a-4bd2-903d-d8e66eb8824c-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:48 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 Apr 21 20:56:48 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-649f89c7-a48a-4bd2-903d-d8e66eb8824c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-quobyte-649f89c7-a48a-4bd2-903d-d8e66eb8824c" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-649f89c7-a48a-4bd2-903d-d8e66eb8824c" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1826c7-244e-42b2-b93c-e0fc6236999c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c Apr 21 20:56:48 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 0 in 0.513s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:48 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22" returned: 0 in 0.433s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20c82f4-c36a-4c24-9fcd-9992b81fd701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308c06ab-07cd-43f1-a0df-ac4117162d22', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94341f1a-fea4-4a2b-b31b-c773cb442ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:48 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Volume volume-308c06ab-07cd-43f1-a0df-ac4117162d22 (308c06ab-07cd-43f1-a0df-ac4117162d22): created successfully Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94341f1a-fea4-4a2b-b31b-c773cb442ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Flow 'volume_create_manager' (ada0d358-bd79-498b-a674-74b54fe94aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:48 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-92389398-1c30-4026-adac-ae9194552291 tempest-VolumesListAdminTestJSON-1167386301 None] Created volume successfully. Apr 21 20:56:48 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c Apr 21 20:56:48 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:48 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 1 in 0.490s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:56:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:48 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd Apr 21 20:56:48 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-649f89c7-a48a-4bd2-903d-d8e66eb8824c" returned: 0 in 0.412s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-649f89c7-a48a-4bd2-903d-d8e66eb8824c" released by "delete_volume" :: held 0.918s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Created reservations ['07a6bd73-4f96-4c71-b1bf-3c41e7b09b2c', '98788185-5609-466f-bd7a-1bba93292771', '0d942458-e77d-48b9-b7f3-4e8c47b0f7b6', 'f1a508cd-462b-473e-b3b0-5cbee59ba488'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:49 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-490e59e1-12d2-40a8-a336-03a52a9ce1bd" returned: 0 in 0.428s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Lock "cinder-quobyte-490e59e1-12d2-40a8-a336-03a52a9ce1bd" released by "delete_volume" :: held 1.474s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:49 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Created reservations ['57beea53-36e3-4b29-9373-0a14fafb5017', 'e51df525-6784-47b0-9cae-d6bc518ad3fa', 'b5d7a106-97b6-4c94-b48c-fa3fcea0e669', 'ebb4bf5e-a440-4f10-93f4-aaf750ebbe4e'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Acquiring lock "cinder-308c06ab-07cd-43f1-a0df-ac4117162d22-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "cinder-308c06ab-07cd-43f1-a0df-ac4117162d22-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:49 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Acquiring lock "cinder-quobyte-308c06ab-07cd-43f1-a0df-ac4117162d22" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "cinder-quobyte-308c06ab-07cd-43f1-a0df-ac4117162d22" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f09b74-d788-4081-bb08-7789d35421a9]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "cinder-589919b4-b683-4b7c-8ac0-c6f35ef33f87-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-589919b4-b683-4b7c-8ac0-c6f35ef33f87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "cinder-quobyte-589919b4-b683-4b7c-8ac0-c6f35ef33f87" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-quobyte-589919b4-b683-4b7c-8ac0-c6f35ef33f87" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29ca1a-26b0-41f0-ba2f-5642d6a107f8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:49 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 Apr 21 20:56:49 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 Apr 21 20:56:49 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:49 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.510s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:49 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Deleted volume successfully. Apr 21 20:56:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-00a69e56-cee7-497b-8275-fde2dd585691 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-649f89c7-a48a-4bd2-903d-d8e66eb8824c-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Deleted volume successfully. Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-189020c2-df42-4d24-823a-0650987e6879 tempest-VolumesImageMetadata-1841832491 None] Lock "cinder-490e59e1-12d2-40a8-a336-03a52a9ce1bd-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22" returned: 0 in 0.600s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22 Apr 21 20:56:50 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87" returned: 0 in 0.561s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87 Apr 21 20:56:50 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-7a7dee38-a733-4df6-9f3d-b972da402247-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-7a7dee38-a733-4df6-9f3d-b972da402247-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-quobyte-7a7dee38-a733-4df6-9f3d-b972da402247" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-7a7dee38-a733-4df6-9f3d-b972da402247" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[715f1392-9c00-4db7-a8e6-c25e405d3271]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:50 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 Apr 21 20:56:50 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:50 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-308c06ab-07cd-43f1-a0df-ac4117162d22" returned: 0 in 0.557s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "cinder-quobyte-308c06ab-07cd-43f1-a0df-ac4117162d22" released by "delete_volume" :: held 1.184s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-589919b4-b683-4b7c-8ac0-c6f35ef33f87" returned: 0 in 0.522s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-quobyte-589919b4-b683-4b7c-8ac0-c6f35ef33f87" released by "delete_volume" :: held 1.106s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Created reservations ['a3a2b811-fe94-4c0b-82d7-a9ec3c288d05', 'b34f25d5-32fb-4c21-be91-648984d1269f', '0124afa0-2ce2-4c56-aecd-71b8accf25d0', 'db2fb9a2-ae28-4113-908f-d8eb90dae9ce'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Created reservations ['ed77d90b-8f16-430b-adde-307f3c6ade26', 'ea9d954a-ae19-4f7e-8af7-1308f0f8c1f5', '576146fd-ff8d-4b3b-a4b1-828a9b1e8557', 'd88c48e7-30d9-47bb-b854-2275129d56d6'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:51 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:51 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247" returned: 0 in 0.638s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247 Apr 21 20:56:51 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.472s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Deleted volume successfully. Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dad3e924-79c8-48c4-a931-07a854c809f6 tempest-VolumesListAdminTestJSON-1167386301 None] Lock "cinder-308c06ab-07cd-43f1-a0df-ac4117162d22-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:51 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.561s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Deleted volume successfully. Apr 21 20:56:51 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7a7dee38-a733-4df6-9f3d-b972da402247" returned: 0 in 0.503s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-7a7dee38-a733-4df6-9f3d-b972da402247" released by "delete_volume" :: held 1.170s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9038c12d-c14f-45b7-a521-c510f51ad2e8 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-589919b4-b683-4b7c-8ac0-c6f35ef33f87-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Created reservations ['b208528e-6a95-4fe6-a48e-3fc5405dd0d3', '4ebdbd77-dbf4-4923-99d0-0148ec25bfc3', '933cc3f8-3068-4109-9e93-d3ba8b8dc866', '47ef2b37-822c-4d09-970b-b53b6be5ed83'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:51 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "cinder-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:51 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:51 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "cinder-quobyte-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Flow 'volume_create_manager' (ac78ca0b-9537-42ea-86c7-fc619be78e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5c193d-1c68-4b1b-8c5c-f25a4f0df861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-quobyte-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9" acquired by "delete_volume" :: waited 0.046s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5c193d-1c68-4b1b-8c5c-f25a4f0df861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2057591854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e295d8a4-419a-4341-a4f7-04bec3f443d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9975dcb1ed234a8bb2890eb8c8805754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:52Z,use_quota=True,user_id='78b85e6c684b469aa8339590e55d5f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d808e19c-1bb4-4954-b2b0-95a08d688520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d808e19c-1bb4-4954-b2b0-95a08d688520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74486434-8d2d-4d06-804a-5e6edf434b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74486434-8d2d-4d06-804a-5e6edf434b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e295d8a4-419a-4341-a4f7-04bec3f443d7', 'volume_name': 'volume-e295d8a4-419a-4341-a4f7-04bec3f443d7', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951ed862-2b34-462e-b634-196b5be06339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951ed862-2b34-462e-b634-196b5be06339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:52 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc3559b-ae42-42ea-b280-f14e22b007fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:52 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Volume e295d8a4-419a-4341-a4f7-04bec3f443d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e295d8a4-419a-4341-a4f7-04bec3f443d7', 'volume_size': 1} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2057591854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e295d8a4-419a-4341-a4f7-04bec3f443d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9975dcb1ed234a8bb2890eb8c8805754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:56:52Z,use_quota=True,user_id='78b85e6c684b469aa8339590e55d5f59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Creating volume e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:56:52 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0852020d-05b2-449d-940a-ac9eb0ca65eb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 1073741824 Apr 21 20:56:52 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:52 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Deleted volume successfully. Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5d287487-6989-43ae-ab87-0d631080bcf9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-7a7dee38-a733-4df6-9f3d-b972da402247-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:52 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 Apr 21 20:56:52 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.404s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-73dd1fdb-1f15-4fe4-b079-41256e245513-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:52 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 1073741824" returned: 0 in 0.487s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-73dd1fdb-1f15-4fe4-b079-41256e245513-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-quobyte-73dd1fdb-1f15-4fe4-b079-41256e245513" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-73dd1fdb-1f15-4fe4-b079-41256e245513" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:52 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c48b128-c2cf-4f17-98a3-3902ecccfe68]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:52 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9" returned: 0 in 0.582s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:52 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9 Apr 21 20:56:52 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:52 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 Apr 21 20:56:52 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7" returned: 0 in 0.459s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc3559b-ae42-42ea-b280-f14e22b007fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e295d8a4-419a-4341-a4f7-04bec3f443d7', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0ff511-7b2c-462d-aab4-9a584bc9643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:56:53 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9" returned: 0 in 0.399s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Volume volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 (e295d8a4-419a-4341-a4f7-04bec3f443d7): created successfully Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0ff511-7b2c-462d-aab4-9a584bc9643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Flow 'volume_create_manager' (ac78ca0b-9537-42ea-86c7-fc619be78e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-quobyte-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9" released by "delete_volume" :: held 1.060s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7b3f0817-e2bf-465f-9cdc-c6bbe17d24ee tempest-SnapshotMetadataTestJSON-2098792447 None] Created volume successfully. Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Created reservations ['7296beb1-a230-4037-a174-9979c6254135', '5267f474-7cf5-4d43-a70f-af9b75444e45', '0cc49dc1-75ee-40b5-8e67-9215d5b4936f', '76562aa8-fd44-4702-a648-14466ca14a0f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:53 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513" returned: 0 in 0.562s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513 Apr 21 20:56:53 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:53 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.409s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Deleted volume successfully. Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-719dcce1-5eb8-4f25-a55f-bd6e12d1c2b5 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-814c115e-a2d7-4799-b2f8-ab5f12e9d4a9-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-73dd1fdb-1f15-4fe4-b079-41256e245513" returned: 0 in 0.439s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-73dd1fdb-1f15-4fe4-b079-41256e245513" released by "delete_volume" :: held 1.022s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Created reservations ['ee899dc2-d45f-4800-8001-13e3a4806c9f', '98e8c1e3-3926-4376-9831-8a35b4cfd796', 'c71b0554-590a-497c-8cdc-8333e3a126c4', '57f3af67-d923-4547-90a6-6cf3b8a08c21'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:53 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:53 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.415s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:54 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Deleted volume successfully. Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d15852b-50e9-43b5-869f-16bb4c9412ae tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-73dd1fdb-1f15-4fe4-b079-41256e245513-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "cinder-1cb2e960-5426-4e29-927a-4e7a86295db5-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-1cb2e960-5426-4e29-927a-4e7a86295db5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "cinder-quobyte-1cb2e960-5426-4e29-927a-4e7a86295db5" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-quobyte-1cb2e960-5426-4e29-927a-4e7a86295db5" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[be09e1ee-497b-4775-aa6a-6de1dd37ed34]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Creating offline snapshot 87ec3b2b-b521-4150-8d32-ef89e292d5f0 of volume e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[985e570b-e91a-4c4c-85a1-8942cd39aa89]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 Apr 21 20:56:54 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 Apr 21 20:56:54 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5 Apr 21 20:56:54 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-ad133271-a6e4-4be9-b712-2de1841f29f1-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-ad133271-a6e4-4be9-b712-2de1841f29f1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7" returned: 0 in 0.522s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-quobyte-ad133271-a6e4-4be9-b712-2de1841f29f1" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:54 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 1G Apr 21 20:56:54 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-ad133271-a6e4-4be9-b712-2de1841f29f1" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaaddca-c730-45a0-b121-78eee5410325]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:54 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 Apr 21 20:56:54 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-1cb2e960-5426-4e29-927a-4e7a86295db5" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-quobyte-1cb2e960-5426-4e29-927a-4e7a86295db5" released by "delete_volume" :: held 0.979s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=188,cinder:UPDATE=234,cinder:DELETE=23,cinder:INSERT=50 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Created reservations ['05e31143-707d-4b0b-95a8-d2252c560fd2', 'f476b5ab-72c1-434b-9750-f7f36abe8530', '2f6d6547-de4f-4cfe-a810-3a41be5493df', '50a50499-3f3f-4b0e-affd-f87a38b076c4'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 1G" returned: 0 in 0.514s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:55 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 Apr 21 20:56:55 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1" returned: 0 in 0.579s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1 Apr 21 20:56:55 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Deleted volume successfully. Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-405e2865-4c0a-45cf-ab91-020a0e422824 tempest-VolumesListAdminTestJSON-1835513151 None] Lock "cinder-1cb2e960-5426-4e29-927a-4e7a86295db5-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:55 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0" returned: 0 in 0.523s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 is being set with open permissions: ugo+rw Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:55 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 Apr 21 20:56:55 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:55 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-ad133271-a6e4-4be9-b712-2de1841f29f1" returned: 0 in 0.534s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-ad133271-a6e4-4be9-b712-2de1841f29f1" released by "delete_volume" :: held 1.138s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Created reservations ['36a4314e-0e46-428b-bcd8-66eb626ecd7a', '250c1166-3bac-48d1-bc20-0113ac9a8cf7', '44da1469-2e40-47a9-99f5-927fc949423d', '0e0b38de-e9ae-41d8-8f1e-f0bae2ab6861'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:56 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info Apr 21 20:56:56 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.464s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Deleted volume successfully. Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-01c96d01-fae7-4999-aaa8-dec21cbc7ee9 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-ad133271-a6e4-4be9-b712-2de1841f29f1-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:56 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:56 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info is being set with open permissions: ugo+rw Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:56 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info Apr 21 20:56:56 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-9fc2c46d-6444-4dc8-9644-c5c8caaff47d-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-9fc2c46d-6444-4dc8-9644-c5c8caaff47d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "cinder-quobyte-9fc2c46d-6444-4dc8-9644-c5c8caaff47d" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-9fc2c46d-6444-4dc8-9644-c5c8caaff47d" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:57 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b275f71-387f-486c-9978-f8e7a33015d2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d Apr 21 20:56:57 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:57 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.info" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-33540671-ee19-4e2a-87ba-eb2c9233b863 tempest-SnapshotMetadataTestJSON-2098792447 None] Create snapshot completed successfully Apr 21 20:56:57 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d" returned: 0 in 0.538s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:57 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d Apr 21 20:56:57 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-9fc2c46d-6444-4dc8-9644-c5c8caaff47d" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-quobyte-9fc2c46d-6444-4dc8-9644-c5c8caaff47d" released by "delete_volume" :: held 1.036s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Created reservations ['49cd9e0a-c286-4b88-aa83-5171810da5e1', 'c20ca62f-8ac3-4801-8a29-bcef5fe95007', 'e77a8597-ac20-49f4-94a3-723ea27b5256', 'd358250f-0e97-425b-a4d3-cffede99d873'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:58 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:56:58 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:58 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.431s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:56:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Deleted volume successfully. Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0fa6e1b1-2b5e-41a9-98fd-f6dab2e3bda6 tempest-CreateVolumesFromImageTest-1247022421 None] Lock "cinder-9fc2c46d-6444-4dc8-9644-c5c8caaff47d-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "cinder-87ec3b2b-b521-4150-8d32-ef89e292d5f0-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-87ec3b2b-b521-4150-8d32-ef89e292d5f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "cinder-quobyte-e295d8a4-419a-4341-a4f7-04bec3f443d7" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-quobyte-e295d8a4-419a-4341-a4f7-04bec3f443d7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "cinder-quobyte-87ec3b2b-b521-4150-8d32-ef89e292d5f0" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-quobyte-87ec3b2b-b521-4150-8d32-ef89e292d5f0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Deleting offline snapshot 87ec3b2b-b521-4150-8d32-ef89e292d5f0 of volume e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] snapshot_file for this snap is: volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0cfb7-d68e-4310-ac04-3be890ab4d98]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 Apr 21 20:56:59 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:56:59 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 21 20:56:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0" returned: 0 in 0.566s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:56:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e295d8a4-419a-4341-a4f7-04bec3f443d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:56:59 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5446b24-20c5-416b-aa4e-c19a1181faef]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:56:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:56:59 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 Apr 21 20:56:59 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7" returned: 0 in 0.563s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 Apr 21 20:57:00 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Flow 'volume_create_manager' (4bee2735-b3b4-4525-a729-be744fb9e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d3e314-9f2c-4d7c-b71e-0f1fca33a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d3e314-9f2c-4d7c-b71e-0f1fca33a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-905529668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3147b226-3457-4c18-ae6f-031a4da4ca33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf454c0b0df46fdaaf7806903cccf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='4a1ccc0de9eb4c8d88a5d0a03954cce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2e46ee-4521-4f79-b229-b3d14dcd8810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2e46ee-4521-4f79-b229-b3d14dcd8810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5e0211-3a36-4880-a725-f72b3c9c7fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5e0211-3a36-4880-a725-f72b3c9c7fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3147b226-3457-4c18-ae6f-031a4da4ca33', 'volume_name': 'volume-3147b226-3457-4c18-ae6f-031a4da4ca33', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168e19f7-bff2-4ef6-825a-e8d76c0f086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168e19f7-bff2-4ef6-825a-e8d76c0f086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58925bfa-a512-40ef-ac5a-1a6c89da6ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:00 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Volume 3147b226-3457-4c18-ae6f-031a4da4ca33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3147b226-3457-4c18-ae6f-031a4da4ca33', 'volume_size': 1} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-905529668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3147b226-3457-4c18-ae6f-031a4da4ca33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf454c0b0df46fdaaf7806903cccf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:00Z,use_quota=True,user_id='4a1ccc0de9eb4c8d88a5d0a03954cce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Creating volume 3147b226-3457-4c18-ae6f-031a4da4ca33 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:00 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 1073741824 Apr 21 20:57:00 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0" returned: 0 in 0.549s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:00 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0 Apr 21 20:57:00 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (ecbad3b8-1e04-4756-8c40-b917b7d2a13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc93899a-9ebc-4321-b2b0-eb332b072afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc93899a-9ebc-4321-b2b0-eb332b072afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532842801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:01Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1db9a4e-bb5a-4946-b789-35ba79393868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1db9a4e-bb5a-4946-b789-35ba79393868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2c0a99-4537-405d-be14-1234e0e6fb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2c0a99-4537-405d-be14-1234e0e6fb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5', 'volume_name': 'volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a8f63-de50-4436-a111-22322e2c84f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9a8f63-de50-4436-a111-22322e2c84f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c6a5c-a07c-4f9c-a4ae-4935ce5e2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5', 'volume_size': 1} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:01 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 1073741824" returned: 0 in 0.514s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 Apr 21 20:57:01 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7.87ec3b2b-b521-4150-8d32-ef89e292d5f0" returned: 0 in 0.515s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-quobyte-87ec3b2b-b521-4150-8d32-ef89e292d5f0" released by "_delete_snapshot" :: held 2.261s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-quobyte-e295d8a4-419a-4341-a4f7-04bec3f443d7" released by "delete_snapshot" :: held 2.277s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Created reservations ['3c406504-49e9-42f5-a3ff-a0fad867afb5', 'f75c4469-808e-4627-897b-c44a4d3860f4', 'd7afe758-937c-4f5d-ad79-1e3744c2bc4d', 'ea81bbdf-43ef-4a3d-9ee6-1a73adaff275'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:01 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Delete snapshot completed successfully. Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-622636de-68d7-42d5-9a30-551935aa6c53 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-87ec3b2b-b521-4150-8d32-ef89e292d5f0-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:01 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33" returned: 0 in 0.415s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532842801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:01Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating volume e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:01 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:01 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 1073741824 Apr 21 20:57:01 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58925bfa-a512-40ef-ac5a-1a6c89da6ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3147b226-3457-4c18-ae6f-031a4da4ca33', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9011e90-256f-452e-8f4d-f6e271df28d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:01 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Volume volume-3147b226-3457-4c18-ae6f-031a4da4ca33 (3147b226-3457-4c18-ae6f-031a4da4ca33): created successfully Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9011e90-256f-452e-8f4d-f6e271df28d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Flow 'volume_create_manager' (4bee2735-b3b4-4525-a729-be744fb9e71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:01 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1d88604c-10a1-4248-b4bb-3f3b5fe50a79 tempest-VolumesTransfersV357Test-2081243422 None] Created volume successfully. Apr 21 20:57:02 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 1073741824" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 Apr 21 20:57:02 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "cinder-e295d8a4-419a-4341-a4f7-04bec3f443d7-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-e295d8a4-419a-4341-a4f7-04bec3f443d7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "cinder-quobyte-e295d8a4-419a-4341-a4f7-04bec3f443d7" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-quobyte-e295d8a4-419a-4341-a4f7-04bec3f443d7" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3831e701-116f-40ff-a380-54091b9a0cd1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 Apr 21 20:57:02 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:02 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" returned: 0 in 0.427s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80c6a5c-a07c-4f9c-a4ae-4935ce5e2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabd9ae1-85fc-45a5-a8e5-4dfca2be3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:02 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 (e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5): created successfully Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabd9ae1-85fc-45a5-a8e5-4dfca2be3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (ecbad3b8-1e04-4756-8c40-b917b7d2a13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:02 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c9731c92-136e-4985-9642-2552df3c7432 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created volume successfully. Apr 21 20:57:02 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7" returned: 0 in 0.521s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:02 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7 Apr 21 20:57:02 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d02156b3-e916-4800-bf8b-3d3e51593d11 tempest-VolumesTransfersV357Test-238669549 None] Transfer volume completed successfully. Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating offline snapshot a88a9f4a-3c52-4822-84b4-1d15ebb76805 of volume e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:03 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e295d8a4-419a-4341-a4f7-04bec3f443d7" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbae11-dd5b-4688-b377-5fa698a7e9a4]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-quobyte-e295d8a4-419a-4341-a4f7-04bec3f443d7" released by "delete_volume" :: held 1.029s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Created reservations ['7dffb205-0008-4fb5-b023-4a47531bfad5', 'f99e14a9-8b5d-4d77-a3de-26157432f544', 'ea278f42-803a-4adb-b8d0-a3c5c22f3050', 'fb1e3f84-d7fe-4a1f-a2de-c9fd6c74ea39'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:03 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 Apr 21 20:57:03 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:03 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.394s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:03 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Deleted volume successfully. Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c12db544-b2a5-4e31-abde-f56e2b2f8c30 tempest-SnapshotMetadataTestJSON-2098792447 None] Lock "cinder-e295d8a4-419a-4341-a4f7-04bec3f443d7-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:03 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" returned: 0 in 0.506s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 1G Apr 21 20:57:03 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Acquiring lock "cinder-3147b226-3457-4c18-ae6f-031a4da4ca33-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-3147b226-3457-4c18-ae6f-031a4da4ca33-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Acquiring lock "cinder-quobyte-3147b226-3457-4c18-ae6f-031a4da4ca33" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-quobyte-3147b226-3457-4c18-ae6f-031a4da4ca33" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20114ae-b5ba-43dc-8bfe-3c52a9724007]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:03 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 Apr 21 20:57:03 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 1G" returned: 0 in 0.459s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 Apr 21 20:57:04 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33" returned: 0 in 0.500s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33 Apr 21 20:57:04 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 is being set with open permissions: ugo+rw Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 Apr 21 20:57:04 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:04 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3147b226-3457-4c18-ae6f-031a4da4ca33" returned: 0 in 0.435s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-quobyte-3147b226-3457-4c18-ae6f-031a4da4ca33" released by "delete_volume" :: held 0.959s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Created reservations ['3478ac2e-c74e-4e76-851e-ed4e3f614535', '3eac7838-360f-4ff1-a073-e455884b5844', 'bfff1e08-37fd-4f75-9fc6-e48894f94556', 'af0b49e9-aef1-4df3-8d0c-cadde0323a8c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:04 devstack sudo[88250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:04 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info Apr 21 20:57:05 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Flow 'volume_create_manager' (417b14a1-19e2-4348-a2d8-bab4276f2117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a930a359-cec9-4f2b-8c55-7b339e09e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a930a359-cec9-4f2b-8c55-7b339e09e58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-440641611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8568f4-6e76-4492-bb27-ad901f694e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf454c0b0df46fdaaf7806903cccf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='4a1ccc0de9eb4c8d88a5d0a03954cce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3238d3d5-38e1-41da-89e7-01d67739b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3238d3d5-38e1-41da-89e7-01d67739b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71f17ad-8000-4998-bf21-d20d0d7ed402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71f17ad-8000-4998-bf21-d20d0d7ed402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8568f4-6e76-4492-bb27-ad901f694e0e', 'volume_name': 'volume-5a8568f4-6e76-4492-bb27-ad901f694e0e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a948503-68c3-4ba2-b41a-e4f291926f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a948503-68c3-4ba2-b41a-e4f291926f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86768cc1-21d5-4368-ad61-4b114a8579cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:05 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Volume 5a8568f4-6e76-4492-bb27-ad901f694e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8568f4-6e76-4492-bb27-ad901f694e0e', 'volume_size': 1} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:05 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.503s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:05 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Deleted volume successfully. Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-aaa47643-0ba5-4ef5-8fd5-ece66a60355a tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-3147b226-3457-4c18-ae6f-031a4da4ca33-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:05 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info" returned: 0 in 0.513s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:05 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info is being set with open permissions: ugo+rw Apr 21 20:57:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:05 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info Apr 21 20:57:05 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.info" returned: 0 in 0.426s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.915s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-440641611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8568f4-6e76-4492-bb27-ad901f694e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbf454c0b0df46fdaaf7806903cccf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:05Z,use_quota=True,user_id='4a1ccc0de9eb4c8d88a5d0a03954cce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Creating volume 5a8568f4-6e76-4492-bb27-ad901f694e0e {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:06 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e 1073741824 Apr 21 20:57:06 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a7d14421-3bd5-4b1b-8e03-80ec69cf2d02 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Create snapshot completed successfully Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (9897846e-204c-4389-99ae-5107b9707f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a412733d-8d90-4a9e-8755-0254fd64df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a412733d-8d90-4a9e-8755-0254fd64df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429808507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357a1f04-e523-4caa-9b18-8a21bd10f9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caededcf-b5f3-4953-870c-2e59ba6d3220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caededcf-b5f3-4953-870c-2e59ba6d3220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9868266-a5ba-469c-8933-01aab463c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9868266-a5ba-469c-8933-01aab463c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357a1f04-e523-4caa-9b18-8a21bd10f9b3', 'volume_name': 'volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdded00-367c-4e61-a400-2041bb32db98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fdded00-367c-4e61-a400-2041bb32db98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaa9442-204f-4c44-b278-e4f09d49980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume 357a1f04-e523-4caa-9b18-8a21bd10f9b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3', 'volume_size': 1} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:06 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e 1073741824" returned: 0 in 0.579s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Flow 'volume_create_manager' (e060f305-3edb-493f-8392-02d99466b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6a44b9-06bb-4afd-8cc1-f9608f47019a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:06 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e Apr 21 20:57:06 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6a44b9-06bb-4afd-8cc1-f9608f47019a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1033562485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168fd4d8-01cd-40f1-911b-de6e7de00e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98112bdee91403caa4686d563b31d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='3380c3e747fa408d83b7dfbfb45e32f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470503a6-4b72-499b-b9d2-9558c96bcc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470503a6-4b72-499b-b9d2-9558c96bcc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa4f69a-891d-4133-9d39-893c8257a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa4f69a-891d-4133-9d39-893c8257a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168fd4d8-01cd-40f1-911b-de6e7de00e4f', 'volume_name': 'volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d03f0cb-f26d-41f6-a8f5-6bf8f5e44232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d03f0cb-f26d-41f6-a8f5-6bf8f5e44232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86779a11-c286-48dd-bed8-caaf33beab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Volume 168fd4d8-01cd-40f1-911b-de6e7de00e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f', 'volume_size': 1} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (cb3e284d-d804-47a7-9046-e59d13bec82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c620562e-732b-487f-adf5-230f0b919620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c620562e-732b-487f-adf5-230f0b919620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705991134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c0aaf4-a663-4792-a548-d6548b0d7e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6712ed9-836c-4eab-a7fa-6cd29c10de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6712ed9-836c-4eab-a7fa-6cd29c10de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbc9917-d7c8-41c0-9cff-7470a5de6df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dbc9917-d7c8-41c0-9cff-7470a5de6df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c0aaf4-a663-4792-a548-d6548b0d7e91', 'volume_name': 'volume-42c0aaf4-a663-4792-a548-d6548b0d7e91', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9431f07-11bd-4687-9356-dd035492e723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9431f07-11bd-4687-9356-dd035492e723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33a005a-d57b-45cd-83cd-4f5de2770c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:06 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume 42c0aaf4-a663-4792-a548-d6548b0d7e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c0aaf4-a663-4792-a548-d6548b0d7e91', 'volume_size': 1} Apr 21 20:57:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (72b89f6c-0fcd-4f9d-ba47-76007d6d5d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29c94f7-b6c5-4569-9ae3-3f9b1931539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29c94f7-b6c5-4569-9ae3-3f9b1931539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-913216267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528f41a7-7a1e-4b6d-8526-5291888381f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44654cb-8d8b-4374-bd60-86807d940c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44654cb-8d8b-4374-bd60-86807d940c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44324cec-4763-473a-a6fc-525f3a60138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44324cec-4763-473a-a6fc-525f3a60138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '528f41a7-7a1e-4b6d-8526-5291888381f9', 'volume_name': 'volume-528f41a7-7a1e-4b6d-8526-5291888381f9', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1a148b-53bc-4043-8ca2-9566fc2a59c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1a148b-53bc-4043-8ca2-9566fc2a59c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce03cc3-9704-4e9c-82c5-f141c881653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume 528f41a7-7a1e-4b6d-8526-5291888381f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-528f41a7-7a1e-4b6d-8526-5291888381f9', 'volume_size': 1} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (9347dfd1-9dd2-48f6-ba09-10d02ca71066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09984e57-1a9c-4604-a15d-072529fbebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.546s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429808507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357a1f04-e523-4caa-9b18-8a21bd10f9b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating volume 357a1f04-e523-4caa-9b18-8a21bd10f9b3 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:07 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09984e57-1a9c-4604-a15d-072529fbebb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268147449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298fdbd9-fbad-4f61-b872-eaaa7855e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 1073741824 Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de755d69-7e9f-4524-97ec-ac81778a64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de755d69-7e9f-4524-97ec-ac81778a64d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b67e44-b459-459a-975b-76aa3180cbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b67e44-b459-459a-975b-76aa3180cbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298fdbd9-fbad-4f61-b872-eaaa7855e0c0', 'volume_name': 'volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7ce6f4-fc7d-43ee-b7b3-6fedc4041504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7ce6f4-fc7d-43ee-b7b3-6fedc4041504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da4cff7-c262-46ce-9300-c38e172821d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume 298fdbd9-fbad-4f61-b872-eaaa7855e0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0', 'volume_size': 1} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86768cc1-21d5-4368-ad61-4b114a8579cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8568f4-6e76-4492-bb27-ad901f694e0e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a619c5c7-5c5e-4ee0-9ec0-a40744c94c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Volume volume-5a8568f4-6e76-4492-bb27-ad901f694e0e (5a8568f4-6e76-4492-bb27-ad901f694e0e): created successfully Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a619c5c7-5c5e-4ee0-9ec0-a40744c94c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Flow 'volume_create_manager' (417b14a1-19e2-4348-a2d8-bab4276f2117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:07 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c0d8d57e-5845-48b9-819b-e73b4ea06319 tempest-VolumesTransfersV357Test-2081243422 None] Created volume successfully. Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (97fe9e56-1baf-4a23-b132-6b4086df7931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022092ca-0e16-4534-80b1-9e0d28560363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022092ca-0e16-4534-80b1-9e0d28560363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153294018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467d2cbc-6353-4d46-a550-e9b08a8fd9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ef2148-2003-4dc6-a4f3-fa6b9ec33bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ef2148-2003-4dc6-a4f3-fa6b9ec33bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913c355e-0318-44b5-b02a-bc32edd1c0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913c355e-0318-44b5-b02a-bc32edd1c0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467d2cbc-6353-4d46-a550-e9b08a8fd9c9', 'volume_name': 'volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10eb4799-201b-4863-bfd7-13d2a01e620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10eb4799-201b-4863-bfd7-13d2a01e620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5bf1629-3047-41d1-bfa4-62b30f938add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:07 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume 467d2cbc-6353-4d46-a550-e9b08a8fd9c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9', 'volume_size': 1} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Acquiring lock "cinder-5a8568f4-6e76-4492-bb27-ad901f694e0e-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-5a8568f4-6e76-4492-bb27-ad901f694e0e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Acquiring lock "cinder-quobyte-5a8568f4-6e76-4492-bb27-ad901f694e0e" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-quobyte-5a8568f4-6e76-4492-bb27-ad901f694e0e" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52f6e7-25a0-40f6-9b8e-3659db4ebece]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e Apr 21 20:57:07 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:07 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 1073741824" returned: 0 in 0.586s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:07 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 Apr 21 20:57:07 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e Apr 21 20:57:08 devstack sudo[88287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3" returned: 0 in 0.412s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1033562485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168fd4d8-01cd-40f1-911b-de6e7de00e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f98112bdee91403caa4686d563b31d97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='3380c3e747fa408d83b7dfbfb45e32f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Creating volume 168fd4d8-01cd-40f1-911b-de6e7de00e4f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:08 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaa9442-204f-4c44-b278-e4f09d49980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:08 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f 1073741824 Apr 21 20:57:08 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efeb9f6a-3a28-47cf-a330-9da45d5a3d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:08 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 (357a1f04-e523-4caa-9b18-8a21bd10f9b3): created successfully Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efeb9f6a-3a28-47cf-a330-9da45d5a3d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (9897846e-204c-4389-99ae-5107b9707f1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:08 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-20dbc76e-5a5e-446a-b82d-55537c3232b4 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created volume successfully. Apr 21 20:57:08 devstack sudo[88287]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5a8568f4-6e76-4492-bb27-ad901f694e0e" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-quobyte-5a8568f4-6e76-4492-bb27-ad901f694e0e" released by "delete_volume" :: held 0.918s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Created reservations ['eedfe2f6-9bf5-4f17-a061-e4e86bd42dec', '84bb8d1c-96e0-4619-aa8f-759aba3f7611', '603447bf-8e3e-48ad-a00a-abe501e64320', 'ff0a7008-5d00-4199-a6c9-3e81acd58f5c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:08 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:08 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f 1073741824" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:08 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f Apr 21 20:57:08 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.481s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Deleted volume successfully. Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-89fe9d0c-ed04-4cec-81c7-b0005e52fd5c tempest-VolumesTransfersV357Test-1447886499 None] Lock "cinder-5a8568f4-6e76-4492-bb27-ad901f694e0e-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:09 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f" returned: 0 in 0.463s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.356s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705991134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c0aaf4-a663-4792-a548-d6548b0d7e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating volume 42c0aaf4-a663-4792-a548-d6548b0d7e91 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:09 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86779a11-c286-48dd-bed8-caaf33beab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edc7115-67ec-4558-99a7-2268c3d85a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:09 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 1073741824 Apr 21 20:57:09 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Volume volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f (168fd4d8-01cd-40f1-911b-de6e7de00e4f): created successfully Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4edc7115-67ec-4558-99a7-2268c3d85a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Flow 'volume_create_manager' (e060f305-3edb-493f-8392-02d99466b320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d480cb01-8453-4cc0-b653-3b4adb06753a tempest-AbsoluteLimitsTests-362641603 None] Created volume successfully. Apr 21 20:57:09 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 1073741824" returned: 0 in 0.524s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:09 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 Apr 21 20:57:09 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Acquiring lock "cinder-168fd4d8-01cd-40f1-911b-de6e7de00e4f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Lock "cinder-168fd4d8-01cd-40f1-911b-de6e7de00e4f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Acquiring lock "cinder-quobyte-168fd4d8-01cd-40f1-911b-de6e7de00e4f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Lock "cinder-quobyte-168fd4d8-01cd-40f1-911b-de6e7de00e4f" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7017f-f4bb-4da8-9700-edeb51590356]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f Apr 21 20:57:10 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.200s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-913216267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528f41a7-7a1e-4b6d-8526-5291888381f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating volume 528f41a7-7a1e-4b6d-8526-5291888381f9 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:10 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a33a005a-d57b-45cd-83cd-4f5de2770c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c0aaf4-a663-4792-a548-d6548b0d7e91', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 1073741824 Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead0c8f1-c33c-4209-9fc7-007a70d01219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:10 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 (42c0aaf4-a663-4792-a548-d6548b0d7e91): created successfully Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead0c8f1-c33c-4209-9fc7-007a70d01219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (cb3e284d-d804-47a7-9046-e59d13bec82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2f6134a5-06b4-4315-a723-b1435d0ee9a2 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created volume successfully. Apr 21 20:57:10 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f" returned: 0 in 0.517s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f Apr 21 20:57:10 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 1073741824" returned: 0 in 0.580s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:10 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 Apr 21 20:57:10 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:10 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-168fd4d8-01cd-40f1-911b-de6e7de00e4f" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Lock "cinder-quobyte-168fd4d8-01cd-40f1-911b-de6e7de00e4f" released by "delete_volume" :: held 1.026s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Created reservations ['4817958a-012f-4546-ab7a-06dc4efac557', 'c36d99ad-37d4-4d76-9a71-07aa52007d0a', 'fda221ab-354e-4986-8ef0-e2bf19ba85f1', '8c90934b-5264-4728-97e1-a31e6e3127ad'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:11 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.097s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1268147449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298fdbd9-fbad-4f61-b872-eaaa7855e0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating volume 298fdbd9-fbad-4f61-b872-eaaa7855e0c0 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:11 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce03cc3-9704-4e9c-82c5-f141c881653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528f41a7-7a1e-4b6d-8526-5291888381f9', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8981584-9ace-4a2a-b9f7-e052c496ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:11 devstack sudo[88328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 1073741824 Apr 21 20:57:11 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:11 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume volume-528f41a7-7a1e-4b6d-8526-5291888381f9 (528f41a7-7a1e-4b6d-8526-5291888381f9): created successfully Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8981584-9ace-4a2a-b9f7-e052c496ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (72b89f6c-0fcd-4f9d-ba47-76007d6d5d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3ecb21d9-f3f5-43f0-a77e-b2626cfd3600 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created volume successfully. Apr 21 20:57:11 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.487s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Deleted volume successfully. Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-10ff4c76-3cd0-454d-a840-2229e73202cd tempest-AbsoluteLimitsTests-362641603 None] Lock "cinder-168fd4d8-01cd-40f1-911b-de6e7de00e4f-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:11 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 1073741824" returned: 0 in 0.564s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:11 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 Apr 21 20:57:11 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Flow 'volume_create_manager' (f056001f-0d89-4a29-b9fe-622823d1dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe523253-7a4c-4649-a4ac-b1492efb8738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe523253-7a4c-4649-a4ac-b1492efb8738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2007533057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7c5f83-9319-4fd0-b118-faf67af320c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e63b009cc448c3b73a4484502f841c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:12Z,use_quota=True,user_id='c6ff56fc50dd4693a226225cc912e542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32641b3-8a1b-4313-a965-6ef105884168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d32641b3-8a1b-4313-a965-6ef105884168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4782b264-e8ed-4589-819b-b81e311416b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4782b264-e8ed-4589-819b-b81e311416b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7c5f83-9319-4fd0-b118-faf67af320c0', 'volume_name': 'volume-db7c5f83-9319-4fd0-b118-faf67af320c0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2ac3d1-1425-44bf-a795-2d321b415c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2ac3d1-1425-44bf-a795-2d321b415c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6b274a-b4b6-42f4-99a1-7544428b652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Volume db7c5f83-9319-4fd0-b118-faf67af320c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7c5f83-9319-4fd0-b118-faf67af320c0', 'volume_size': 1} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:12 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.989s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153294018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467d2cbc-6353-4d46-a550-e9b08a8fd9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4867358499334d21b98621dd9a3866ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:07Z,use_quota=True,user_id='fae67c96fd3e4281a6aa6b4679b7313e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Creating volume 467d2cbc-6353-4d46-a550-e9b08a8fd9c9 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:12 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da4cff7-c262-46ce-9300-c38e172821d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 1073741824 Apr 21 20:57:12 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9cbe41-1571-4bd7-a6f7-e248b13b42f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:12 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 (298fdbd9-fbad-4f61-b872-eaaa7855e0c0): created successfully Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9cbe41-1571-4bd7-a6f7-e248b13b42f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (9347dfd1-9dd2-48f6-ba09-10d02ca71066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3f85d4a1-f5d3-470b-8a59-50cfa3b84fcc tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created volume successfully. Apr 21 20:57:13 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 1073741824" returned: 0 in 0.619s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 Apr 21 20:57:13 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9" returned: 0 in 0.432s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2007533057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db7c5f83-9319-4fd0-b118-faf67af320c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e63b009cc448c3b73a4484502f841c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:12Z,use_quota=True,user_id='c6ff56fc50dd4693a226225cc912e542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Creating volume db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:13 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5bf1629-3047-41d1-bfa4-62b30f938add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:13 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 1073741824 Apr 21 20:57:13 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6692bb4d-68d8-43e8-be48-a5488312eecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:13 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Volume volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 (467d2cbc-6353-4d46-a550-e9b08a8fd9c9): created successfully Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6692bb4d-68d8-43e8-be48-a5488312eecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Flow 'volume_create_manager' (97fe9e56-1baf-4a23-b132-6b4086df7931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:13 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-97893d6f-471d-4060-a743-3ae42e9ce33b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created volume successfully. Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-467d2cbc-6353-4d46-a550-e9b08a8fd9c9-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-467d2cbc-6353-4d46-a550-e9b08a8fd9c9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-467d2cbc-6353-4d46-a550-e9b08a8fd9c9" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-467d2cbc-6353-4d46-a550-e9b08a8fd9c9" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d1fdf7-bae4-40eb-ba0c-280f1ea09ae5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 Apr 21 20:57:14 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 1073741824" returned: 0 in 0.554s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:14 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:14 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9 Apr 21 20:57:14 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:14 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.445s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6b274a-b4b6-42f4-99a1-7544428b652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7c5f83-9319-4fd0-b118-faf67af320c0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b809b008-c0e3-40d9-91f9-9b25039625c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:14 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Volume volume-db7c5f83-9319-4fd0-b118-faf67af320c0 (db7c5f83-9319-4fd0-b118-faf67af320c0): created successfully Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b809b008-c0e3-40d9-91f9-9b25039625c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Flow 'volume_create_manager' (f056001f-0d89-4a29-b9fe-622823d1dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:14 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-754f45c7-706e-41df-a0fc-449a4e157415 tempest-VolumesCloneTest-1925786949 None] Created volume successfully. Apr 21 20:57:14 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-467d2cbc-6353-4d46-a550-e9b08a8fd9c9" returned: 0 in 0.465s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-467d2cbc-6353-4d46-a550-e9b08a8fd9c9" released by "delete_volume" :: held 1.026s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['e5fd1c74-f024-4153-817b-c32930ba4deb', 'ff0c3708-e939-4f5a-a9ee-08f53ba35ade', 'abcd6f1d-aff8-4fa4-ba2a-9d2cae685b77', 'de936f68-0446-4d23-8a70-3fe71bc9aa6c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:15 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleted volume successfully. Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4460a29d-ea69-4690-9fcf-de32c5452bfd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-467d2cbc-6353-4d46-a550-e9b08a8fd9c9-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Flow 'volume_create_manager' (b21bb0f5-4a63-4b2f-917d-3d6934071fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ba972-19b8-4fc9-bd98-beb40a5c24bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ba972-19b8-4fc9-bd98-beb40a5c24bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-459472275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712660e0-d1aa-4082-8654-3dc4147af24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322468e32850488c83ac1ed315cab35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:16Z,use_quota=True,user_id='d2cdd91b738f4169ae86487f2d459868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911b0dbe-f292-4b48-870a-ff1f16bed578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911b0dbe-f292-4b48-870a-ff1f16bed578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348ea9b5-269d-4491-8eae-abfda99fa630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348ea9b5-269d-4491-8eae-abfda99fa630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712660e0-d1aa-4082-8654-3dc4147af24b', 'volume_name': 'volume-712660e0-d1aa-4082-8654-3dc4147af24b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd3373b-1cdd-4fe8-bbe2-013f80d80b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd3373b-1cdd-4fe8-bbe2-013f80d80b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10672dc9-35db-43f4-ac61-756acb02c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Volume 712660e0-d1aa-4082-8654-3dc4147af24b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712660e0-d1aa-4082-8654-3dc4147af24b', 'volume_size': 1} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-459472275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712660e0-d1aa-4082-8654-3dc4147af24b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322468e32850488c83ac1ed315cab35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:16Z,use_quota=True,user_id='d2cdd91b738f4169ae86487f2d459868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Creating volume 712660e0-d1aa-4082-8654-3dc4147af24b {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:15 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:15 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b 1073741824 Apr 21 20:57:15 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Flow 'volume_create_manager' (55f75849-b629-4e13-bf2e-8d2e468b5df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca8e1dc-7bf4-465b-bc45-3bd34d5e7abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca8e1dc-7bf4-465b-bc45-3bd34d5e7abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-928245310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c653365-1059-4b7a-a45c-6300a63666c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e63b009cc448c3b73a4484502f841c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=db7c5f83-9319-4fd0-b118-faf67af320c0,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:16Z,use_quota=True,user_id='c6ff56fc50dd4693a226225cc912e542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29630448-17b3-4696-8a59-e76c2abacb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29630448-17b3-4696-8a59-e76c2abacb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2859c01a-d661-4fb2-89d5-b44e9a3495b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2859c01a-d661-4fb2-89d5-b44e9a3495b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0c653365-1059-4b7a-a45c-6300a63666c6', 'volume_name': 'volume-0c653365-1059-4b7a-a45c-6300a63666c6', 'volume_size': 2, 'source_volid': 'db7c5f83-9319-4fd0-b118-faf67af320c0', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6750c8d3-8dba-4d45-9b59-5ae5e615eed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6750c8d3-8dba-4d45-9b59-5ae5e615eed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0959776c-02fb-45f5-b175-6e8dfe037109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Volume 0c653365-1059-4b7a-a45c-6300a63666c6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0c653365-1059-4b7a-a45c-6300a63666c6', 'volume_size': 2, 'source_volid': 'db7c5f83-9319-4fd0-b118-faf67af320c0', 'source_volstatus': 'available'} Apr 21 20:57:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-298fdbd9-fbad-4f61-b872-eaaa7855e0c0-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-298fdbd9-fbad-4f61-b872-eaaa7855e0c0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-298fdbd9-fbad-4f61-b872-eaaa7855e0c0" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-298fdbd9-fbad-4f61-b872-eaaa7855e0c0" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:16 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b 1073741824" returned: 0 in 0.476s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[48820a7c-bbe4-43b1-9039-e33f69952898]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b Apr 21 20:57:16 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 Apr 21 20:57:16 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b" returned: 0 in 0.399s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.807s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:16 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Cloning volume db7c5f83-9319-4fd0-b118-faf67af320c0 to volume 0c653365-1059-4b7a-a45c-6300a63666c6 Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10672dc9-35db-43f4-ac61-756acb02c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712660e0-d1aa-4082-8654-3dc4147af24b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c78ff4-dcc5-4445-817e-7657abc4ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:16 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Volume volume-712660e0-d1aa-4082-8654-3dc4147af24b (712660e0-d1aa-4082-8654-3dc4147af24b): created successfully Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c78ff4-dcc5-4445-817e-7657abc4ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:16 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Flow 'volume_create_manager' (b21bb0f5-4a63-4b2f-917d-3d6934071fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Creating offline snapshot b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 of volume db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6dc7accc-dda8-494c-9f69-884e7edddee3 tempest-VolumesTransfersTest-1199290449 None] Created volume successfully. Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a47fb25-c81d-4c91-ba54-cd18aadcb905]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:16 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0 Apr 21 20:57:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:16 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:16 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:16 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-298fdbd9-fbad-4f61-b872-eaaa7855e0c0" returned: 0 in 0.388s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-298fdbd9-fbad-4f61-b872-eaaa7855e0c0" released by "delete_volume" :: held 0.889s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['0b7a943e-21c6-4a85-ae47-266e4ffa7660', '4702aafd-88b7-49d0-afa8-0dbaa136f1bb', '96efab65-ee88-4cf9-af44-458b58625670', '85c679b6-b884-4d76-86cc-409b2ffe8226'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:17 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.448s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:17 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 1G Apr 21 20:57:17 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-528f41a7-7a1e-4b6d-8526-5291888381f9-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-528f41a7-7a1e-4b6d-8526-5291888381f9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-528f41a7-7a1e-4b6d-8526-5291888381f9" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-528f41a7-7a1e-4b6d-8526-5291888381f9" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[540068b2-70db-4b1e-876b-94e9939e9d19]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 Apr 21 20:57:17 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.437s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleted volume successfully. Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-38a80b01-22c1-42ae-96e8-91222d11c98a tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-298fdbd9-fbad-4f61-b872-eaaa7855e0c0-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:17 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 1G" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7c5f83-9319-4fd0-b118-faf67af320c0 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7c5f83-9319-4fd0-b118-faf67af320c0 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 Apr 21 20:57:17 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:17 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9" returned: 0 in 0.523s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:17 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9 Apr 21 20:57:17 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db7c5f83-9319-4fd0-b118-faf67af320c0 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" returned: 0 in 0.464s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 is being set with open permissions: ugo+rw Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 Apr 21 20:57:18 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0caba940-298c-49ed-bf1d-5cacff6dedc6 tempest-VolumesTransfersTest-47183166 None] Transfer volume completed successfully. Apr 21 20:57:18 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-528f41a7-7a1e-4b6d-8526-5291888381f9" returned: 0 in 0.404s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-528f41a7-7a1e-4b6d-8526-5291888381f9" released by "delete_volume" :: held 0.946s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['d448dd61-c237-42d6-99cb-f458b22415ad', 'e5eb8d9b-f981-447f-a99a-640416eebc85', 'ed257733-0894-49c3-971b-78357cdae2e1', 'c721c59c-aee7-4109-a5e0-c520318dc305'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:18 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-42c0aaf4-a663-4792-a548-d6548b0d7e91-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-42c0aaf4-a663-4792-a548-d6548b0d7e91-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-42c0aaf4-a663-4792-a548-d6548b0d7e91" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-42c0aaf4-a663-4792-a548-d6548b0d7e91" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee02f8-60db-4c23-b5f7-02deaf84b13b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" returned: 0 in 0.443s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info Apr 21 20:57:18 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 Apr 21 20:57:18 devstack sudo[88449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.484s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleted volume successfully. Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6186bae8-8d80-46cb-b2b7-53ed0d417821 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-528f41a7-7a1e-4b6d-8526-5291888381f9-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:18 devstack sudo[88449]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info is being set with open permissions: ugo+rw Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info Apr 21 20:57:18 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91" returned: 0 in 0.526s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:18 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91 Apr 21 20:57:18 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Acquiring lock "cinder-712660e0-d1aa-4082-8654-3dc4147af24b-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Lock "cinder-712660e0-d1aa-4082-8654-3dc4147af24b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Acquiring lock "cinder-quobyte-712660e0-d1aa-4082-8654-3dc4147af24b" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Lock "cinder-quobyte-712660e0-d1aa-4082-8654-3dc4147af24b" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[66759fd5-bcd9-4c12-9e07-7ad79859c92c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b Apr 21 20:57:19 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.info" returned: 0 in 0.393s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Acquiring lock "cinder-quobyte-0c653365-1059-4b7a-a45c-6300a63666c6" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-0c653365-1059-4b7a-a45c-6300a63666c6" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] snapshot: b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3, volume: 0c653365-1059-4b7a-a45c-6300a63666c6, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb4de4a-5215-4c6e-8b1c-3754a2dcd2e8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-42c0aaf4-a663-4792-a548-d6548b0d7e91" returned: 0 in 0.437s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-42c0aaf4-a663-4792-a548-d6548b0d7e91" released by "delete_volume" :: held 0.984s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:19 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 Apr 21 20:57:19 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['c0be9a81-9b47-4021-9db6-7170d90ce2bb', '30c37a08-66e4-41f0-806d-6c522d5b9738', 'caebdf16-ed00-43b8-96ae-6b7881daa9eb', '4d897fec-0854-4535-89fa-ef8c729b4f1f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:19 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b" returned: 0 in 0.499s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b Apr 21 20:57:19 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" returned: 0 in 0.467s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7c5f83-9319-4fd0-b118-faf67af320c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc4400-696c-4328-be5d-e05b2ca67792]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:19 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:19 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:19 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.424s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:19 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleted volume successfully. Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3ede54f0-87b9-4b28-a804-7c138fa033cd tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-42c0aaf4-a663-4792-a548-d6548b0d7e91-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:19 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-712660e0-d1aa-4082-8654-3dc4147af24b" returned: 0 in 0.432s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Lock "cinder-quobyte-712660e0-d1aa-4082-8654-3dc4147af24b" released by "delete_volume" :: held 0.950s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Created reservations ['1cf6e695-2591-4b97-b3d6-2660808be198', 'fd25e74c-2a9b-4e88-8e5f-4094ab7bbec3', '22222898-0ff9-48a6-9a96-f3e1360da81b', '133fe702-1d89-4eb8-bd36-b15f8d17df11'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:20 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.516s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:20 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 Apr 21 20:57:20 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Flow 'volume_create_manager' (78d7f803-e946-44aa-940d-f12f7198f55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0b4b0b-83af-4671-ad86-da883a57c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0b4b0b-83af-4671-ad86-da883a57c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-503649924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b91bd6d-dc58-4b6e-8e08-e94833c121ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322468e32850488c83ac1ed315cab35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:20Z,use_quota=True,user_id='d2cdd91b738f4169ae86487f2d459868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46ca5b8-5080-465a-93c2-300227ef06d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46ca5b8-5080-465a-93c2-300227ef06d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5afbbce-283d-460c-8813-dba1107248af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5afbbce-283d-460c-8813-dba1107248af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b91bd6d-dc58-4b6e-8e08-e94833c121ed', 'volume_name': 'volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6691e06f-91a0-49f7-986d-b5666a3829cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6691e06f-91a0-49f7-986d-b5666a3829cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e31db8-ced0-41bb-bc31-dd6d9fa448cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:20 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Volume 3b91bd6d-dc58-4b6e-8e08-e94833c121ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed', 'volume_size': 1} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-357a1f04-e523-4caa-9b18-8a21bd10f9b3-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-357a1f04-e523-4caa-9b18-8a21bd10f9b3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:20 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.464s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:20 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Deleted volume successfully. Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-357a1f04-e523-4caa-9b18-8a21bd10f9b3" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-357a1f04-e523-4caa-9b18-8a21bd10f9b3" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fd684f00-c98a-4b66-a6e2-5af42de5620f tempest-VolumesTransfersTest-201409528 None] Lock "cinder-712660e0-d1aa-4082-8654-3dc4147af24b-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[118cfe5c-2833-4f04-8bb3-f05a68a9f4e4]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:20 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 Apr 21 20:57:20 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:21 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3" returned: 0 in 1.037s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:21 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3 Apr 21 20:57:21 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6" returned: 0 in 1.884s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4199cc5e-a4af-4204-82c9-33f6ee85527a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:22 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-357a1f04-e523-4caa-9b18-8a21bd10f9b3" returned: 0 in 0.807s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-357a1f04-e523-4caa-9b18-8a21bd10f9b3" released by "delete_volume" :: held 1.878s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['54b41b91-403f-4062-b71f-332c2c72bf7e', '032cfb12-ddce-4de5-840b-a35f50821b21', '2dedf7de-6a6e-4bda-be93-b877c9693b1b', '66cb37a5-255d-4527-9bdf-749363d34678'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:22 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-a88a9f4a-3c52-4822-84b4-1d15ebb76805-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-a88a9f4a-3c52-4822-84b4-1d15ebb76805-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-a88a9f4a-3c52-4822-84b4-1d15ebb76805" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-a88a9f4a-3c52-4822-84b4-1d15ebb76805" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleting offline snapshot a88a9f4a-3c52-4822-84b4-1d15ebb76805 of volume e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] snapshot_file for this snap is: volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db5a2cb-bb96-4f8c-be28-1eecf40fdc1e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.609s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:22 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Converted 1024.00 MB image at 543.10 MB/s Apr 21 20:57:22 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 is being set with open permissions: ugo+rw Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:22 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 Apr 21 20:57:22 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 Apr 21 20:57:22 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:22 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.412s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleted volume successfully. Apr 21 20:57:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0ae19e8e-1f2c-459a-9b16-a44dc828780b tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-357a1f04-e523-4caa-9b18-8a21bd10f9b3-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:23 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffe4c70-25d3-4bc5-bb87-fabb99ce06f3]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6" returned: 0 in 0.429s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-0c653365-1059-4b7a-a45c-6300a63666c6" released by "_copy_volume_from_snapshot" :: held 3.951s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Acquiring lock "cinder-quobyte-b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Deleting offline snapshot b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 of volume db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] snapshot_file for this snap is: volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[de625715-39ce-4640-9812-87a3d37ee928]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 Apr 21 20:57:23 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 Apr 21 20:57:23 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" returned: 0 in 0.484s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 Apr 21 20:57:23 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:23 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" returned: 0 in 0.463s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db7c5f83-9319-4fd0-b118-faf67af320c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8f959-0255-4dd3-8cce-d95f6203eaa2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:23 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:23 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805" returned: 0 in 0.448s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805 Apr 21 20:57:24 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 Apr 21 20:57:24 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5.a88a9f4a-3c52-4822-84b4-1d15ebb76805" returned: 0 in 0.396s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-a88a9f4a-3c52-4822-84b4-1d15ebb76805" released by "_delete_snapshot" :: held 1.852s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" released by "delete_snapshot" :: held 1.868s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['5ed098b2-6760-4e7e-b531-74ac8339570e', '4ea991ac-20ed-4eca-b79f-9ded76db34e2', '0e7573c2-06fb-4128-ad12-0683facc80b5', '227e799a-d674-49ec-a19c-8fc5365ec071'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:24 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Delete snapshot completed successfully. Apr 21 20:57:24 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-36cf9b26-384c-4a00-a645-e5e75c9a8267 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-a88a9f4a-3c52-4822-84b4-1d15ebb76805-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:24 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3 Apr 21 20:57:24 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "cinder-quobyte-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ca071-dba9-47c8-9f5d-84143a745e60]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 Apr 21 20:57:25 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0.b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" returned: 0 in 0.424s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-b0483b69-4265-4b7f-ab49-4bd7d6c4ddf3" released by "_delete_snapshot" :: held 1.840s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.601s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.739s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-503649924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b91bd6d-dc58-4b6e-8e08-e94833c121ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322468e32850488c83ac1ed315cab35b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:20Z,use_quota=True,user_id='d2cdd91b738f4169ae86487f2d459868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Creating volume 3b91bd6d-dc58-4b6e-8e08-e94833c121ed {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:25 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0959776c-02fb-45f5-b175-6e8dfe037109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c653365-1059-4b7a-a45c-6300a63666c6', 'volume_size': 2, 'source_volid': 'db7c5f83-9319-4fd0-b118-faf67af320c0', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:25 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed 1073741824 Apr 21 20:57:25 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a94bc5-2d3e-4282-9079-fcaadfca2ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:25 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Volume volume-0c653365-1059-4b7a-a45c-6300a63666c6 (0c653365-1059-4b7a-a45c-6300a63666c6): created successfully Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45a94bc5-2d3e-4282-9079-fcaadfca2ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Flow 'volume_create_manager' (55f75849-b629-4e13-bf2e-8d2e468b5df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:25 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4e02490b-db20-4e94-98a8-59b34e448481 tempest-VolumesCloneTest-1925786949 None] Created volume successfully. Apr 21 20:57:25 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" returned: 0 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5 Apr 21 20:57:25 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed 1073741824" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed Apr 21 20:57:25 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:25 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-quobyte-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5" released by "delete_volume" :: held 0.954s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Created reservations ['c3131085-4b7d-4820-818d-fdd711b58d32', '6a2a427c-7c0e-44a6-9236-97eab1d9c9a9', '2b77f10d-562c-4628-9527-3c92e946ae7e', '5c2eac21-314d-415d-96b6-7859e13d03f2'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:25 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:25 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e31db8-ced0-41bb-bc31-dd6d9fa448cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f0cffa-91c1-434f-b038-8a9bf518f2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:26 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Volume volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed (3b91bd6d-dc58-4b6e-8e08-e94833c121ed): created successfully Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50f0cffa-91c1-434f-b038-8a9bf518f2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Flow 'volume_create_manager' (78d7f803-e946-44aa-940d-f12f7198f55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Acquiring lock "cinder-0c653365-1059-4b7a-a45c-6300a63666c6-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e394a853-7830-4b30-bd7e-24f67d38f094 tempest-VolumesTransfersTest-1199290449 None] Created volume successfully. Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Lock "cinder-0c653365-1059-4b7a-a45c-6300a63666c6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Acquiring lock "cinder-quobyte-0c653365-1059-4b7a-a45c-6300a63666c6" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-0c653365-1059-4b7a-a45c-6300a63666c6" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3fc038-22df-4a59-bc2c-9a067500059b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 Apr 21 20:57:26 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Deleted volume successfully. Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-15b00a52-67f8-447d-8198-fba2714d7d06 tempest-CreateVolumesFromSnapshotTest-2103065355 None] Lock "cinder-e4fa90f1-4c8e-4428-9f81-4bf2c5baa6f5-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:26 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6" returned: 0 in 0.558s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:26 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6 Apr 21 20:57:26 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Acquiring lock "cinder-3b91bd6d-dc58-4b6e-8e08-e94833c121ed-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Lock "cinder-3b91bd6d-dc58-4b6e-8e08-e94833c121ed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Acquiring lock "cinder-quobyte-3b91bd6d-dc58-4b6e-8e08-e94833c121ed" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Lock "cinder-quobyte-3b91bd6d-dc58-4b6e-8e08-e94833c121ed" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d271ce8-29ac-449b-9ec7-9d13548d8e3d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed Apr 21 20:57:27 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0c653365-1059-4b7a-a45c-6300a63666c6" returned: 0 in 0.469s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-0c653365-1059-4b7a-a45c-6300a63666c6" released by "delete_volume" :: held 1.047s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Created reservations ['3b14082b-7e66-47e1-9cd6-17e48dd5b3cb', '55c0f135-83e1-4fbb-afb9-c8555d1ca8ce', '7b75c6d3-ef66-4768-a50b-4c444ab07fa3', '958e3a45-f2ce-482a-825e-7aa7dc23b59e'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:27 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed" returned: 0 in 0.526s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed Apr 21 20:57:27 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Flow 'volume_create_manager' (ebdc741b-3992-464f-a9d5-e944cdda1f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207249ae-c6e9-4f0f-9414-ce2d164b0b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (207249ae-c6e9-4f0f-9414-ce2d164b0b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5add1a48-60a3-4cda-b98a-218f8efb76f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e1d72dd3a7476da13b09ea48871bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:28Z,use_quota=True,user_id='10f5495391a14089a21dacb1aa44a5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344d3be1-085c-41b8-9095-7971f870fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344d3be1-085c-41b8-9095-7971f870fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afc0c17-a518-4342-abb2-94f9d3fab58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afc0c17-a518-4342-abb2-94f9d3fab58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5add1a48-60a3-4cda-b98a-218f8efb76f0', 'volume_name': 'volume-5add1a48-60a3-4cda-b98a-218f8efb76f0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592e18d2-177b-47f0-9b6b-8ae5d405a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592e18d2-177b-47f0-9b6b-8ae5d405a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4654d07-19b9-446a-922c-f48fc27c9556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:27 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Volume 5add1a48-60a3-4cda-b98a-218f8efb76f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5add1a48-60a3-4cda-b98a-218f8efb76f0', 'volume_size': 1} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5add1a48-60a3-4cda-b98a-218f8efb76f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e1d72dd3a7476da13b09ea48871bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:28Z,use_quota=True,user_id='10f5495391a14089a21dacb1aa44a5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Creating volume 5add1a48-60a3-4cda-b98a-218f8efb76f0 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:27 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:27 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 1073741824 Apr 21 20:57:27 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:27 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.444s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:27 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Deleted volume successfully. Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-6259e455-f3a1-4303-9a93-a357550fa8af tempest-VolumesCloneTest-1925786949 None] Lock "cinder-0c653365-1059-4b7a-a45c-6300a63666c6-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:27 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-3b91bd6d-dc58-4b6e-8e08-e94833c121ed" returned: 0 in 0.420s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Lock "cinder-quobyte-3b91bd6d-dc58-4b6e-8e08-e94833c121ed" released by "delete_volume" :: held 0.965s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Created reservations ['492cd1c5-7857-4ebf-bea9-b62571c70bae', '1031f125-8817-4ffb-8575-72b2be45e995', 'a80d7740-6033-498a-a1f6-97335128c56e', 'ec299f17-e6cd-4a85-8c27-51a5c162d100'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:28 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 1073741824" returned: 0 in 0.508s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 Apr 21 20:57:28 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Acquiring lock "cinder-db7c5f83-9319-4fd0-b118-faf67af320c0-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Lock "cinder-db7c5f83-9319-4fd0-b118-faf67af320c0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Acquiring lock "cinder-quobyte-db7c5f83-9319-4fd0-b118-faf67af320c0" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-db7c5f83-9319-4fd0-b118-faf67af320c0" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc289b5-6082-437e-893f-914eeb61005e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:28 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.499s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:28 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Deleted volume successfully. Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1a288790-7936-456e-bd62-004e45135ba4 tempest-VolumesTransfersTest-201409528 None] Lock "cinder-3b91bd6d-dc58-4b6e-8e08-e94833c121ed-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:28 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:28 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:28 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0" returned: 0 in 0.517s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4654d07-19b9-446a-922c-f48fc27c9556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5add1a48-60a3-4cda-b98a-218f8efb76f0', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534207cf-08fe-4d14-a2d4-9ab2b6add9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:28 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Volume volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 (5add1a48-60a3-4cda-b98a-218f8efb76f0): created successfully Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534207cf-08fe-4d14-a2d4-9ab2b6add9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Flow 'volume_create_manager' (ebdc741b-3992-464f-a9d5-e944cdda1f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:28 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-64d747f9-31f1-491d-950e-4c6544e931e4 tempest-CinderUnicodeTest-1375895984 None] Created volume successfully. Apr 21 20:57:29 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.574s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0 Apr 21 20:57:29 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:29 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-db7c5f83-9319-4fd0-b118-faf67af320c0" returned: 0 in 0.542s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Lock "cinder-quobyte-db7c5f83-9319-4fd0-b118-faf67af320c0" released by "delete_volume" :: held 1.153s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Created reservations ['9c7165f5-b0cf-4429-b778-f41f2bff4ea5', 'e981b918-400e-4f70-8452-137a8d375f45', '9a85b119-af09-4c37-8a7e-45c1aa94feb8', '26e04aa0-f591-4c48-8393-4f5f336a8fe4'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:29 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:29 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Flow 'volume_create_manager' (0ce46b97-dcd7-40a6-a063-9e372d7fca2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304de361-dc5d-4899-b339-964f5438d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (304de361-dc5d-4899-b339-964f5438d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1155909902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f2ea02-6588-4a2c-b79a-cfed0e491e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e1d72dd3a7476da13b09ea48871bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:30Z,use_quota=True,user_id='10f5495391a14089a21dacb1aa44a5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e1c5a7-a039-4a35-9cf9-c7ad74c16266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e1c5a7-a039-4a35-9cf9-c7ad74c16266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a7cf08-6f1b-4af4-85f6-64c7a6d65480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a7cf08-6f1b-4af4-85f6-64c7a6d65480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f2ea02-6588-4a2c-b79a-cfed0e491e80', 'volume_name': 'volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e8956a-de43-44de-8ee2-7c668f6e9124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e8956a-de43-44de-8ee2-7c668f6e9124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e50e943-30ac-4f5d-adaf-00265d731575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:30 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Volume b2f2ea02-6588-4a2c-b79a-cfed0e491e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80', 'volume_size': 1} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1155909902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f2ea02-6588-4a2c-b79a-cfed0e491e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e1d72dd3a7476da13b09ea48871bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:30Z,use_quota=True,user_id='10f5495391a14089a21dacb1aa44a5df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Creating volume b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:30 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 1073741824 Apr 21 20:57:30 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:30 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.575s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:30 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Deleted volume successfully. Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e3582d36-586b-4add-b9d7-1e8c2487745c tempest-VolumesCloneTest-1925786949 None] Lock "cinder-db7c5f83-9319-4fd0-b118-faf67af320c0-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:30 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 1073741824" returned: 0 in 0.540s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:30 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 Apr 21 20:57:30 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:31 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" returned: 0 in 0.532s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e50e943-30ac-4f5d-adaf-00265d731575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da518b28-dbf8-4435-9717-c3106f051fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:31 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Volume volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 (b2f2ea02-6588-4a2c-b79a-cfed0e491e80): created successfully Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da518b28-dbf8-4435-9717-c3106f051fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:31 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Flow 'volume_create_manager' (0ce46b97-dcd7-40a6-a063-9e372d7fca2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-87afcee2-e9f7-46db-9c21-ba1a173e3c6e tempest-CinderUnicodeTest-1375895984 None] Created volume successfully. Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Creating offline snapshot af381dc4-1966-44ec-bec5-88158a184024 of volume b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3004e6ef-ae10-4d97-9529-10243e2ba65c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:32 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 Apr 21 20:57:32 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (06b96362-f09e-4764-8a8a-5aa2fe13be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4a86a9-b259-46b2-a624-93bab224f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4a86a9-b259-46b2-a624-93bab224f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-870124546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5438c87b-b934-4a4c-b388-27e37ccf3461,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:32Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f0e228-e2dd-41e1-b7f4-6f75e0b353cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f0e228-e2dd-41e1-b7f4-6f75e0b353cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a45f61f-4f11-494b-bb58-8239fad54dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a45f61f-4f11-494b-bb58-8239fad54dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5438c87b-b934-4a4c-b388-27e37ccf3461', 'volume_name': 'volume-5438c87b-b934-4a4c-b388-27e37ccf3461', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24acb47-42cf-49f3-9a5e-c0e3cefd8d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24acb47-42cf-49f3-9a5e-c0e3cefd8d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4bb4e3-7036-46d2-a152-74ec7aa5682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:32 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Volume 5438c87b-b934-4a4c-b388-27e37ccf3461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5438c87b-b934-4a4c-b388-27e37ccf3461', 'volume_size': 1} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:32 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" returned: 0 in 0.498s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:32 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 1G Apr 21 20:57:32 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 1G" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 Apr 21 20:57:33 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:33 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024" returned: 0 in 0.454s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:33 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 is being set with open permissions: ugo+rw Apr 21 20:57:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:33 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 Apr 21 20:57:33 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024" returned: 0 in 0.492s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info Apr 21 20:57:34 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:34 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info" returned: 0 in 0.476s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:34 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info is being set with open permissions: ugo+rw Apr 21 20:57:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:34 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info Apr 21 20:57:34 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.info" returned: 0 in 0.413s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.848s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.712s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-870124546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5438c87b-b934-4a4c-b388-27e37ccf3461,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:32Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Creating volume 5438c87b-b934-4a4c-b388-27e37ccf3461 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:35 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 1073741824 Apr 21 20:57:35 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e158ef56-344e-4036-abd4-2a55672773c1 tempest-CinderUnicodeTest-1375895984 None] Create snapshot completed successfully Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-af381dc4-1966-44ec-bec5-88158a184024-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-af381dc4-1966-44ec-bec5-88158a184024-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-quobyte-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-quobyte-af381dc4-1966-44ec-bec5-88158a184024" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-af381dc4-1966-44ec-bec5-88158a184024" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Deleting offline snapshot af381dc4-1966-44ec-bec5-88158a184024 of volume b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] snapshot_file for this snap is: volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a37839-928d-46ee-8ec8-0a22a7cea79a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 Apr 21 20:57:35 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:35 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 1073741824" returned: 0 in 0.542s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:35 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 Apr 21 20:57:35 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024" returned: 0 in 0.499s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfcef68-957e-46bf-8607-b981f53d609d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 Apr 21 20:57:36 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:36 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461" returned: 0 in 0.414s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4bb4e3-7036-46d2-a152-74ec7aa5682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5438c87b-b934-4a4c-b388-27e37ccf3461', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22810d64-c0bb-44e7-a954-444d915e07b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:36 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Volume volume-5438c87b-b934-4a4c-b388-27e37ccf3461 (5438c87b-b934-4a4c-b388-27e37ccf3461): created successfully Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22810d64-c0bb-44e7-a954-444d915e07b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (06b96362-f09e-4764-8a8a-5aa2fe13be57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:36 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d7cbee2e-cddf-4b47-b061-d596a10d1828 tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:57:36 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" returned: 0 in 0.502s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:36 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 Apr 21 20:57:36 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (6a8c91f4-50d7-4aa6-a01d-c60ca5161478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d05036-e476-4ec9-9051-7af66ba7afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:37 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d05036-e476-4ec9-9051-7af66ba7afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989535629',display_name='tempest-VolumesGetTest-Volume-1373620288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e700e191-31e1-4316-844f-d7d1c8f1d5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:37Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269b37e7-6128-4c57-b8c3-080abfa11e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269b37e7-6128-4c57-b8c3-080abfa11e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe56323-bd09-456c-a9b6-396c8d598583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe56323-bd09-456c-a9b6-396c8d598583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e700e191-31e1-4316-844f-d7d1c8f1d5f6', 'volume_name': 'volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b930b2b-fd59-4996-a8da-930fd3ca2273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b930b2b-fd59-4996-a8da-930fd3ca2273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab080358-a98b-4805-ac75-fa5d41e8101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:37 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Volume e700e191-31e1-4316-844f-d7d1c8f1d5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6', 'volume_size': 1} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1989535629',display_name='tempest-VolumesGetTest-Volume-1373620288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e700e191-31e1-4316-844f-d7d1c8f1d5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:37Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Creating volume e700e191-31e1-4316-844f-d7d1c8f1d5f6 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:37 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024" returned: 0 in 0.591s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 1073741824 Apr 21 20:57:37 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024 Apr 21 20:57:37 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80.af381dc4-1966-44ec-bec5-88158a184024" returned: 0 in 0.423s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-af381dc4-1966-44ec-bec5-88158a184024" released by "_delete_snapshot" :: held 2.107s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" released by "delete_snapshot" :: held 2.126s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Created reservations ['0d81bd95-576d-404c-b025-310314a7aa81', '019fc4c4-b451-40da-8361-78e83529374f', '63dbe6d4-3926-47f2-b492-ec70d127b538', '22588085-8a25-4c99-9254-ad6b2462ad9c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:37 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 1073741824" returned: 0 in 0.533s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:37 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 Apr 21 20:57:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Delete snapshot completed successfully. Apr 21 20:57:37 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d1284b2f-a63a-4d9f-8c08-2b29f1b89262 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-af381dc4-1966-44ec-bec5-88158a184024-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:38 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab080358-a98b-4805-ac75-fa5d41e8101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6d6430-bfcb-4f41-9ace-535c8aef6fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:38 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Volume volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 (e700e191-31e1-4316-844f-d7d1c8f1d5f6): created successfully Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6d6430-bfcb-4f41-9ace-535c8aef6fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (6a8c91f4-50d7-4aa6-a01d-c60ca5161478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:38 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0d6e2dee-5413-41ec-b7d4-a36c2b1e21b3 tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-b2f2ea02-6588-4a2c-b79a-cfed0e491e80-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-b2f2ea02-6588-4a2c-b79a-cfed0e491e80-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-quobyte-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70f3c44-f196-4f5f-824b-d49ca12183c0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:38 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 Apr 21 20:57:38 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" returned: 0 in 0.449s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80 Apr 21 20:57:39 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-e700e191-31e1-4316-844f-d7d1c8f1d5f6-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Lock "cinder-e700e191-31e1-4316-844f-d7d1c8f1d5f6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-e700e191-31e1-4316-844f-d7d1c8f1d5f6" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-e700e191-31e1-4316-844f-d7d1c8f1d5f6" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f678d2-1879-4669-82f5-e38341d79a8f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 Apr 21 20:57:39 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" returned: 0 in 0.426s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-b2f2ea02-6588-4a2c-b79a-cfed0e491e80" released by "delete_volume" :: held 0.914s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Created reservations ['359cb7cb-6409-4a99-a275-19e04949774f', 'ccb8afd8-55c0-4854-a7b0-fe058b75634d', '3ad1abec-6ce4-4886-8339-7f9f63664b5c', 'b6867336-b54b-4af1-8998-4c3788bd0e1c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:39 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-5add1a48-60a3-4cda-b98a-218f8efb76f0-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-5add1a48-60a3-4cda-b98a-218f8efb76f0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "cinder-quobyte-5add1a48-60a3-4cda-b98a-218f8efb76f0" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-5add1a48-60a3-4cda-b98a-218f8efb76f0" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e9223f-8fc1-481c-ae85-d502bc7d645a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:39 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:39 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 Apr 21 20:57:39 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6" returned: 0 in 0.583s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6 Apr 21 20:57:40 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.431s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Deleted volume successfully. Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-599d0997-2488-4bbc-b8d1-649487e66bc9 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-b2f2ea02-6588-4a2c-b79a-cfed0e491e80-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:40 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0" returned: 0 in 0.498s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0 Apr 21 20:57:40 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e700e191-31e1-4316-844f-d7d1c8f1d5f6" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-e700e191-31e1-4316-844f-d7d1c8f1d5f6" released by "delete_volume" :: held 1.087s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Created reservations ['aeb59048-d8b0-4839-ad6b-c2aa54015846', '8375faa9-264c-4a95-b5cb-54de489027c4', 'f43bffb4-e8f3-4a6a-8122-7229e62e8746', '02446b41-c271-4a20-8a68-423ce43f8c32'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:40 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:40 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5add1a48-60a3-4cda-b98a-218f8efb76f0" returned: 0 in 0.434s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-quobyte-5add1a48-60a3-4cda-b98a-218f8efb76f0" released by "delete_volume" :: held 0.954s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Created reservations ['54778bf4-3db0-4388-bfb8-a3c358fd5818', '5cc566c3-7586-47c2-b6bb-e6410dd5cc2f', '7788cc8d-51b3-4a85-95ce-a3842fe1ecfb', '25a98f6e-f290-4adb-8646-8647148a9ed3'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:40 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:40 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:41 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-70e29037-4a76-4f65-9814-6d1f24217e4d tempest-VolumesGetTest-524111213 None] Lock "cinder-e700e191-31e1-4316-844f-d7d1c8f1d5f6-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.525s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Deleted volume successfully. Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-61bdb1fc-d32c-4034-af3a-3dfe1afddb40 tempest-CinderUnicodeTest-1375895984 None] Lock "cinder-5add1a48-60a3-4cda-b98a-218f8efb76f0-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-5438c87b-b934-4a4c-b388-27e37ccf3461-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Lock "cinder-5438c87b-b934-4a4c-b388-27e37ccf3461-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-5438c87b-b934-4a4c-b388-27e37ccf3461" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-5438c87b-b934-4a4c-b388-27e37ccf3461" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f9a46-d605-4cf2-b5d1-533ba4a871d6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:41 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 Apr 21 20:57:41 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461" returned: 0 in 0.528s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461 Apr 21 20:57:42 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:42 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5438c87b-b934-4a4c-b388-27e37ccf3461" returned: 0 in 0.413s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-5438c87b-b934-4a4c-b388-27e37ccf3461" released by "delete_volume" :: held 0.977s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Created reservations ['db0e378d-f120-4871-ae86-504c3c441be3', '605918db-ab13-45a4-87e5-3882c8e44fcc', '857027e4-5ccd-40b3-99c1-5acbdd5f2d93', '7abd2102-e275-4d03-b555-6c2ee21df177'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:42 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:42 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:43 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.407s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:43 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:43 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:57:43 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-31a19265-b2e3-4eaf-88f3-96c09a312cdf tempest-VolumesGetTest-524111213 None] Lock "cinder-5438c87b-b934-4a4c-b388-27e37ccf3461-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:43 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (da094d1e-b9ba-4729-92de-5601b6d3dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfaea0b5-1dfb-426a-936a-75942d2d838f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=330,cinder:DELETE=30,cinder:SELECT=226,cinder:INSERT=86 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfaea0b5-1dfb-426a-936a-75942d2d838f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-751310495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa587353-c12f-4817-a67e-b6150c466a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:44Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89be1c1b-d998-4755-9b16-34827e4401eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89be1c1b-d998-4755-9b16-34827e4401eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0472cf-55a2-49cf-b7d9-81eea2eaa5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0472cf-55a2-49cf-b7d9-81eea2eaa5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa587353-c12f-4817-a67e-b6150c466a76', 'volume_name': 'volume-aa587353-c12f-4817-a67e-b6150c466a76', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7553eb3c-385d-43e8-afc5-7c817da1c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7553eb3c-385d-43e8-afc5-7c817da1c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2034ad56-eab9-46e3-9c89-1a37c2474698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Volume aa587353-c12f-4817-a67e-b6150c466a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa587353-c12f-4817-a67e-b6150c466a76', 'volume_size': 1} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-751310495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa587353-c12f-4817-a67e-b6150c466a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:44Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Creating volume aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:44 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 1073741824 Apr 21 20:57:44 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 1073741824" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:44 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:44 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:44 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.379s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2034ad56-eab9-46e3-9c89-1a37c2474698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa587353-c12f-4817-a67e-b6150c466a76', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d6b2ca-3713-4fa7-bb5b-ca1911d7c49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Volume volume-aa587353-c12f-4817-a67e-b6150c466a76 (aa587353-c12f-4817-a67e-b6150c466a76): created successfully Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d6b2ca-3713-4fa7-bb5b-ca1911d7c49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (da094d1e-b9ba-4729-92de-5601b6d3dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-26a091f1-386f-44d0-9682-b75868e3188f tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (d351c832-33e5-4c72-a192-07e6662afc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7fabe0-7d21-4711-9d83-2a4d91b2e4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7fabe0-7d21-4711-9d83-2a4d91b2e4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1176473283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15226462-22e8-4422-9659-f74b3cd527ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=aa587353-c12f-4817-a67e-b6150c466a76,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:45Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a88ddc-1aab-4c6b-9010-9b9cca46b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a88ddc-1aab-4c6b-9010-9b9cca46b53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b72e01-42f8-4992-a032-746b23aed607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b72e01-42f8-4992-a032-746b23aed607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '15226462-22e8-4422-9659-f74b3cd527ea', 'volume_name': 'volume-15226462-22e8-4422-9659-f74b3cd527ea', 'volume_size': 1, 'source_volid': 'aa587353-c12f-4817-a67e-b6150c466a76', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c955b3e-3ef8-43da-a18b-2b5d62f57e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c955b3e-3ef8-43da-a18b-2b5d62f57e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d80812-2126-458f-8fd9-88323e2886da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Volume 15226462-22e8-4422-9659-f74b3cd527ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-15226462-22e8-4422-9659-f74b3cd527ea', 'volume_size': 1, 'source_volid': 'aa587353-c12f-4817-a67e-b6150c466a76', 'source_volstatus': 'available'} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:45 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Cloning volume aa587353-c12f-4817-a67e-b6150c466a76 to volume 15226462-22e8-4422-9659-f74b3cd527ea Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Creating offline snapshot 6ff1a9c1-ca20-4b85-9489-02886248925e of volume aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7037474-2fd5-4662-9130-e2fa0c7f41c5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:45 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:45 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.436s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:45 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e 1G Apr 21 20:57:45 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e 1G" returned: 0 in 0.446s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa587353-c12f-4817-a67e-b6150c466a76 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa587353-c12f-4817-a67e-b6150c466a76 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e Apr 21 20:57:46 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:46 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa587353-c12f-4817-a67e-b6150c466a76 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e" returned: 0 in 0.410s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:46 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e is being set with open permissions: ugo+rw Apr 21 20:57:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:46 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e Apr 21 20:57:46 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e" returned: 0 in 0.380s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info Apr 21 20:57:47 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info" returned: 0 in 0.387s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info is being set with open permissions: ugo+rw Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info Apr 21 20:57:47 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:47 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.info" returned: 0 in 0.387s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-15226462-22e8-4422-9659-f74b3cd527ea" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-15226462-22e8-4422-9659-f74b3cd527ea" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] snapshot: 6ff1a9c1-ca20-4b85-9489-02886248925e, volume: 15226462-22e8-4422-9659-f74b3cd527ea, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[872ed721-b688-479e-b2a3-9ed01a6a9096]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:47 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e Apr 21 20:57:47 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e" returned: 0 in 0.444s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa587353-c12f-4817-a67e-b6150c466a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb0fd0-4a1c-403d-ab41-dbc24194d5a3]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:48 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:48 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.459s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:57:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:48 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea Apr 21 20:57:48 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:50 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea" returned: 0 in 1.798s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e64c27e-d090-4801-a269-e67ee4f3b993]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:50 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:50 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.579s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:57:51 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Converted 1024.00 MB image at 569.28 MB/s Apr 21 20:57:51 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea is being set with open permissions: ugo+rw Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea Apr 21 20:57:51 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea" returned: 0 in 0.409s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-15226462-22e8-4422-9659-f74b3cd527ea" released by "_copy_volume_from_snapshot" :: held 3.731s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-6ff1a9c1-ca20-4b85-9489-02886248925e" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-6ff1a9c1-ca20-4b85-9489-02886248925e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Deleting offline snapshot 6ff1a9c1-ca20-4b85-9489-02886248925e of volume aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] snapshot_file for this snap is: volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a123677-7910-433a-bfbd-918cc7f2196d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e Apr 21 20:57:51 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:51 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:51 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa587353-c12f-4817-a67e-b6150c466a76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[89290251-0dbf-480e-9b54-63df37862f86]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:52 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:52 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.409s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:52 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.458s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:52 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e Apr 21 20:57:52 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e" returned: 0 in 0.446s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:53 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e Apr 21 20:57:53 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:53 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76.6ff1a9c1-ca20-4b85-9489-02886248925e" returned: 0 in 0.410s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-6ff1a9c1-ca20-4b85-9489-02886248925e" released by "_delete_snapshot" :: held 1.832s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.113s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d80812-2126-458f-8fd9-88323e2886da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15226462-22e8-4422-9659-f74b3cd527ea', 'volume_size': 1, 'source_volid': 'aa587353-c12f-4817-a67e-b6150c466a76', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6273b24-5a3f-45ff-8cba-5fa81d43f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:53 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Volume volume-15226462-22e8-4422-9659-f74b3cd527ea (15226462-22e8-4422-9659-f74b3cd527ea): created successfully Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6273b24-5a3f-45ff-8cba-5fa81d43f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (d351c832-33e5-4c72-a192-07e6662afc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-67f7cb87-6e45-40e0-88d4-7e98f1b63e6f tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (7fcf30ee-9bc6-4c09-94d2-08e8a15c50fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887440b4-c918-41de-82cc-01567bd484fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (887440b4-c918-41de-82cc-01567bd484fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2018278429',display_name='tempest-VolumesGetTest-Volume-464253049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75aade9-486c-4634-963c-1cafdb361f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:54Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c296c33f-ac43-4804-a586-009c6372518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c296c33f-ac43-4804-a586-009c6372518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1499880-b75c-4170-ba9c-644637287b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1499880-b75c-4170-ba9c-644637287b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75aade9-486c-4634-963c-1cafdb361f7b', 'volume_name': 'volume-b75aade9-486c-4634-963c-1cafdb361f7b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb462f8b-9885-4c99-935c-26c8148d7dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb462f8b-9885-4c99-935c-26c8148d7dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4607c57c-1e75-4f94-8d13-9beed809f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:54 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Volume b75aade9-486c-4634-963c-1cafdb361f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75aade9-486c-4634-963c-1cafdb361f7b', 'volume_size': 1} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2018278429',display_name='tempest-VolumesGetTest-Volume-464253049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75aade9-486c-4634-963c-1cafdb361f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:54Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Creating volume b75aade9-486c-4634-963c-1cafdb361f7b {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:57:54 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b 1073741824 Apr 21 20:57:54 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:54 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b 1073741824" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:54 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b Apr 21 20:57:54 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b" returned: 0 in 0.404s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4607c57c-1e75-4f94-8d13-9beed809f36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75aade9-486c-4634-963c-1cafdb361f7b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100d83af-4b62-440e-84fa-4ac798cbd404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:55 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Volume volume-b75aade9-486c-4634-963c-1cafdb361f7b (b75aade9-486c-4634-963c-1cafdb361f7b): created successfully Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100d83af-4b62-440e-84fa-4ac798cbd404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (7fcf30ee-9bc6-4c09-94d2-08e8a15c50fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fecd8ff1-2c12-4a61-87b1-c4c1b0ab75e0 tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-b75aade9-486c-4634-963c-1cafdb361f7b-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Lock "cinder-b75aade9-486c-4634-963c-1cafdb361f7b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=251,cinder:SELECT=174,cinder:DELETE=22,cinder:INSERT=63 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-b75aade9-486c-4634-963c-1cafdb361f7b" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-b75aade9-486c-4634-963c-1cafdb361f7b" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e4aecc-2271-4efa-a2b1-1d47d3b8b562]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b Apr 21 20:57:55 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:55 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b" returned: 0 in 0.474s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:55 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b Apr 21 20:57:55 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-b75aade9-486c-4634-963c-1cafdb361f7b" returned: 0 in 0.405s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-b75aade9-486c-4634-963c-1cafdb361f7b" released by "delete_volume" :: held 0.900s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Created reservations ['22fb1575-642b-4c3a-a06f-eeaac2c212b7', '90273754-54e9-43ea-b326-703b7444eead', '92f53da7-3cb3-43ef-8448-c66f54ba5146', '481acc85-7978-4494-b4f2-c561380780e6'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:56 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-15226462-22e8-4422-9659-f74b3cd527ea-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Lock "cinder-15226462-22e8-4422-9659-f74b3cd527ea-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-15226462-22e8-4422-9659-f74b3cd527ea" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-15226462-22e8-4422-9659-f74b3cd527ea" acquired by "delete_volume" :: waited 0.006s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9cd52-8c5c-4156-bd57-e09629595a34]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea Apr 21 20:57:56 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:56 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.448s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1f18b38e-a7e1-43c3-9b0e-d7854d983b8e tempest-VolumesGetTest-524111213 None] Lock "cinder-b75aade9-486c-4634-963c-1cafdb361f7b-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:56 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:56 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea Apr 21 20:57:56 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-15226462-22e8-4422-9659-f74b3cd527ea" returned: 0 in 0.418s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-15226462-22e8-4422-9659-f74b3cd527ea" released by "delete_volume" :: held 0.935s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Created reservations ['7e72b69e-4b66-447e-9824-6023e53b5b7c', '3e4f727a-a81b-4649-95ff-1be254c7a6c1', '84245556-efbd-4453-8a4f-9d9abde601ed', '617f38ba-91d8-4eb0-b60a-cbb52edb57c2'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:57 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:57 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-aa587353-c12f-4817-a67e-b6150c466a76-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Lock "cinder-aa587353-c12f-4817-a67e-b6150c466a76-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-aa587353-c12f-4817-a67e-b6150c466a76" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-aa587353-c12f-4817-a67e-b6150c466a76" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7548586e-b148-4f22-9e45-e91cd1376065]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:57 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:57 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:57 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:57:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9f884b7e-338c-4215-bcb8-c46c7323b3a6 tempest-VolumesGetTest-524111213 None] Lock "cinder-15226462-22e8-4422-9659-f74b3cd527ea-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:58 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.528s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76 Apr 21 20:57:58 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:58 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa587353-c12f-4817-a67e-b6150c466a76" returned: 0 in 0.395s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-aa587353-c12f-4817-a67e-b6150c466a76" released by "delete_volume" :: held 0.951s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Created reservations ['a475ef5c-c2ea-40c7-a749-be1969809be5', 'c97524e8-ceea-40f6-8805-0a5fce6cee07', '166cc750-f513-4ac9-bb01-e46ff2aca05c', '6efec863-9083-4143-90e1-6ec0cb4423dd'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:57:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:58 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:57:58 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (ed32fe9d-e25a-4aff-bff3-30b32b29bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fb0ce6-ac34-4e3e-882a-24f82fdb8bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fb0ce6-ac34-4e3e-882a-24f82fdb8bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-983596677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b18a38-e9de-436d-984f-a73a537544ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:59Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f862a50d-290a-4b2e-8ee0-2dcd8bb6bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f862a50d-290a-4b2e-8ee0-2dcd8bb6bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de47a938-b992-4a53-aa78-745dfcd3c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.image.glance [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Creating Keystone auth plugin from conf {{(pid=81991) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 21 20:57:59 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:57:59 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-daf8f7c2-e411-4ee8-82f1-363bc7d2f978 tempest-VolumesGetTest-524111213 None] Lock "cinder-aa587353-c12f-4817-a67e-b6150c466a76-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de47a938-b992-4a53-aa78-745dfcd3c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87b18a38-e9de-436d-984f-a73a537544ce', 'volume_name': 'volume-87b18a38-e9de-436d-984f-a73a537544ce', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1242845-6348-4879-aee6-2c3669a0e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1242845-6348-4879-aee6-2c3669a0e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ef53a8-ee65-45cf-bb1a-026bd4dbacdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:57:59 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Volume 87b18a38-e9de-436d-984f-a73a537544ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87b18a38-e9de-436d-984f-a73a537544ce', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Trying to clone 87b18a38-e9de-436d-984f-a73a537544ce from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]). {{(pid=81991) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 21 20:57:59 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Image download 20.69 MB at 20.69 MB/s Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[10021d6f-e7a1-4d9d-871a-49f52f8e07ee]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:57:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:57:59 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD Apr 21 20:57:59 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 is fetched for user 35c063a76ba14ad395ab5803965597d8. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b1122-caf4-4ca5-a4b9-bec7b43fada7]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD Apr 21 20:58:00 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:00 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-983596677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b18a38-e9de-436d-984f-a73a537544ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:57:59Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Creating volume 87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:00 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:00 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce 1073741824 Apr 21 20:58:00 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce 1073741824" returned: 0 in 0.470s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack sudo[88871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:01 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 0 in 0.390s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Attempting download of 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume 87b18a38-e9de-436d-984f-a73a537544ce. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2c489f-ad02-4138-9907-117d047e5474]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw Apr 21 20:58:01 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:01 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:01 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw Apr 21 20:58:01 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw" returned: 1 in 0.466s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_vg_3lzuw' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bbb896-2f09-4304-9bb2-3990b2066875]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD Apr 21 20:58:02 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:02 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 was qcow2, converting to raw {{(pid=81991) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 21 20:58:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:02 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:02 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:03 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 0 in 0.959s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:03 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0df64fc1-33b6-4b8a-a445-b6ec6793fa02_moqcm0ikdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:03 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Converted 112.00 MB image at 112.00 MB/s Apr 21 20:58:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:03 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce 1G Apr 21 20:58:03 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce 1G" returned: 0 in 0.421s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[75afea45-e4a2-43b4-a8ea-e7baa0ba9206]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:04 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:04 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 0 in 0.459s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:04 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:04 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:05 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 1 in 0.467s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Downloaded image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 ((None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}])) to volume 87b18a38-e9de-436d-984f-a73a537544ce successfully. {{(pid=81991) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Temporary image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 for user 35c063a76ba14ad395ab5803965597d8 is deleted. {{(pid=81991) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.volume_utils [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Marking volume 87b18a38-e9de-436d-984f-a73a537544ce as bootable. {{(pid=81991) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Copying metadata from image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 to 87b18a38-e9de-436d-984f-a73a537544ce. {{(pid=81991) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Creating volume glance metadata for volume 87b18a38-e9de-436d-984f-a73a537544ce backed by image 0df64fc1-33b6-4b8a-a445-b6ec6793fa02 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81991) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ef53a8-ee65-45cf-bb1a-026bd4dbacdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b18a38-e9de-436d-984f-a73a537544ce', 'volume_size': 1, 'image_id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f2af2291b53242f68ff7a6f68ac21747', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0df64fc1-33b6-4b8a-a445-b6ec6793fa02', 'created_at': datetime.datetime(2026, 4, 21, 18, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 18, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0df64fc1-33b6-4b8a-a445-b6ec6793fa02/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6abbf2-1e7b-43d4-8096-661211804dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:05 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Volume volume-87b18a38-e9de-436d-984f-a73a537544ce (87b18a38-e9de-436d-984f-a73a537544ce): created successfully Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6abbf2-1e7b-43d4-8096-661211804dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (ed32fe9d-e25a-4aff-bff3-30b32b29bc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:05 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-34df52ea-e516-4430-a495-50ef084faae2 tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (f634629f-3269-4478-ade8-ed4625c2405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b466da65-eb42-4300-957d-5cb3408e168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b466da65-eb42-4300-957d-5cb3408e168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1801300653',display_name='tempest-VolumesGetTest-Volume-84573801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f799e5f8-49e5-43ea-9c77-135583f9a567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dfda7e-5049-4ca2-b041-b48dbd4c1c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18dfda7e-5049-4ca2-b041-b48dbd4c1c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab5a571-65de-4781-9db8-555a96f1d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab5a571-65de-4781-9db8-555a96f1d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f799e5f8-49e5-43ea-9c77-135583f9a567', 'volume_name': 'volume-f799e5f8-49e5-43ea-9c77-135583f9a567', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d4668f-9cea-49aa-b29c-89b477f211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d4668f-9cea-49aa-b29c-89b477f211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dad3690-bc18-4906-8123-26603665a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:05 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Volume f799e5f8-49e5-43ea-9c77-135583f9a567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f799e5f8-49e5-43ea-9c77-135583f9a567', 'volume_size': 1} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1801300653',display_name='tempest-VolumesGetTest-Volume-84573801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f799e5f8-49e5-43ea-9c77-135583f9a567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ccac66c86b4a22a7bd3dbb550540eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:06Z,use_quota=True,user_id='35c063a76ba14ad395ab5803965597d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Creating volume f799e5f8-49e5-43ea-9c77-135583f9a567 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:05 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:05 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 1073741824 Apr 21 20:58:05 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 1073741824" returned: 0 in 0.479s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:06 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 Apr 21 20:58:06 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:06 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567" returned: 0 in 0.399s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dad3690-bc18-4906-8123-26603665a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f799e5f8-49e5-43ea-9c77-135583f9a567', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35152075-698c-452e-ae80-8aa651fe4b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:06 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Volume volume-f799e5f8-49e5-43ea-9c77-135583f9a567 (f799e5f8-49e5-43ea-9c77-135583f9a567): created successfully Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35152075-698c-452e-ae80-8aa651fe4b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:06 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Flow 'volume_create_manager' (f634629f-3269-4478-ade8-ed4625c2405c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:06 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9a9c850e-701f-4150-a8fe-8464b8ab82a7 tempest-VolumesGetTest-524111213 None] Created volume successfully. Apr 21 20:58:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-f799e5f8-49e5-43ea-9c77-135583f9a567-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Lock "cinder-f799e5f8-49e5-43ea-9c77-135583f9a567-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-f799e5f8-49e5-43ea-9c77-135583f9a567" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-f799e5f8-49e5-43ea-9c77-135583f9a567" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e35cb98-ebdb-4599-ad5f-49b396002983]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 Apr 21 20:58:08 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567" returned: 0 in 0.442s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567 Apr 21 20:58:08 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:08 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f799e5f8-49e5-43ea-9c77-135583f9a567" returned: 0 in 0.385s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-f799e5f8-49e5-43ea-9c77-135583f9a567" released by "delete_volume" :: held 0.847s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Created reservations ['b8267aeb-4616-4d69-ac4a-59e32e5c8788', '80745fab-bd9e-461e-b217-528eae87a686', 'd90b0ce2-6e59-4a01-9001-1e232b84d80d', 'c676d21d-83d0-40d5-a131-970d48b5f0a1'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:08 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:08 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-87b18a38-e9de-436d-984f-a73a537544ce-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Lock "cinder-87b18a38-e9de-436d-984f-a73a537544ce-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Acquiring lock "cinder-quobyte-87b18a38-e9de-436d-984f-a73a537544ce" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-87b18a38-e9de-436d-984f-a73a537544ce" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01c3e7c-e6dd-4022-b544-7d338ef6abb6]: (4, 'raw') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:09 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:09 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.424s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-996c06b1-7bab-49e8-bf98-0ab6051dc11f tempest-VolumesGetTest-524111213 None] Lock "cinder-f799e5f8-49e5-43ea-9c77-135583f9a567-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:09 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 0 in 0.470s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:09 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:09 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 1 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce' failed. Not Retrying. {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:10 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce Apr 21 20:58:10 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-87b18a38-e9de-436d-984f-a73a537544ce" returned: 0 in 0.387s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Lock "cinder-quobyte-87b18a38-e9de-436d-984f-a73a537544ce" released by "delete_volume" :: held 1.349s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Created reservations ['ac96f8b6-e021-4cdc-acd7-3cd9f225d023', '300fcfd3-bc27-44b0-b9e0-720513645c14', '0ad1ff75-c4fa-4f1f-acac-2e7657decfb6', '5de1db65-ef67-4420-9814-1a2bb03c6e9f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:10 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:10 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:10 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.386s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:10 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Deleted volume successfully. Apr 21 20:58:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-f796affa-b03d-4c1a-a87e-b33aafeff0ee tempest-VolumesGetTest-524111213 None] Lock "cinder-87b18a38-e9de-436d-984f-a73a537544ce-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Flow 'volume_create_manager' (92dc6872-f5ca-4284-9737-1ac250edd364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376efd49-4799-4e6f-9fba-8a6afacb06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376efd49-4799-4e6f-9fba-8a6afacb06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121643530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcff4cf-934d-4f44-83bd-306865ec5e5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8adbe3c99cb5400e9081d01608bdeb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:13Z,use_quota=True,user_id='ef62695776914295abbd4a61d3a0081b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847785fb-5311-403b-ac3c-d5a8bb6a13a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847785fb-5311-403b-ac3c-d5a8bb6a13a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cd451b-4d56-44a2-a43d-238bd7860efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cd451b-4d56-44a2-a43d-238bd7860efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcff4cf-934d-4f44-83bd-306865ec5e5c', 'volume_name': 'volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db59633-58a1-49ce-8f6e-f984fedcfbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db59633-58a1-49ce-8f6e-f984fedcfbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ccfa41-e71e-4d59-a99f-488d4439add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:12 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Volume 5fcff4cf-934d-4f44-83bd-306865ec5e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c', 'volume_size': 1} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-121643530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcff4cf-934d-4f44-83bd-306865ec5e5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8adbe3c99cb5400e9081d01608bdeb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:13Z,use_quota=True,user_id='ef62695776914295abbd4a61d3a0081b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Creating volume 5fcff4cf-934d-4f44-83bd-306865ec5e5c {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:12 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:12 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c 1073741824 Apr 21 20:58:12 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c 1073741824" returned: 0 in 0.476s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:13 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c Apr 21 20:58:13 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:13 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c" returned: 0 in 0.406s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ccfa41-e71e-4d59-a99f-488d4439add5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c3df66-341b-41c1-bf24-a7554b7ac84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:13 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Volume volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c (5fcff4cf-934d-4f44-83bd-306865ec5e5c): created successfully Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c3df66-341b-41c1-bf24-a7554b7ac84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:13 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Flow 'volume_create_manager' (92dc6872-f5ca-4284-9737-1ac250edd364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:13 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-23dac503-edb8-493a-997d-65cc592e350a tempest-VolumesListTestJSON-911409666 None] Created volume successfully. Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Flow 'volume_create_manager' (7fc8fcb5-92a5-4f64-981c-44eee219b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba9a393-c18a-407e-825d-d8d209d4726e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba9a393-c18a-407e-825d-d8d209d4726e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-27337282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0913dc4c-d381-4e45-92a5-af592c43735f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8adbe3c99cb5400e9081d01608bdeb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:15Z,use_quota=True,user_id='ef62695776914295abbd4a61d3a0081b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34312f47-7ba7-4493-a756-4289e0a2e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34312f47-7ba7-4493-a756-4289e0a2e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6215c3a4-badc-4ce7-846d-b3b9c9394faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6215c3a4-badc-4ce7-846d-b3b9c9394faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0913dc4c-d381-4e45-92a5-af592c43735f', 'volume_name': 'volume-0913dc4c-d381-4e45-92a5-af592c43735f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e259271-bb0b-4b43-b3bb-28c4526912c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e259271-bb0b-4b43-b3bb-28c4526912c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452a1add-77ed-4d54-80e1-bf8cb41997b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Volume 0913dc4c-d381-4e45-92a5-af592c43735f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0913dc4c-d381-4e45-92a5-af592c43735f', 'volume_size': 1} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-27337282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0913dc4c-d381-4e45-92a5-af592c43735f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8adbe3c99cb5400e9081d01608bdeb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:15Z,use_quota=True,user_id='ef62695776914295abbd4a61d3a0081b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Creating volume 0913dc4c-d381-4e45-92a5-af592c43735f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:15 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f 1073741824 Apr 21 20:58:15 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:15 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f 1073741824" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:15 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f Apr 21 20:58:15 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:16 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f" returned: 0 in 0.390s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452a1add-77ed-4d54-80e1-bf8cb41997b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0913dc4c-d381-4e45-92a5-af592c43735f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5960f3e-e1f0-4818-a209-e481efeb8eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Volume volume-0913dc4c-d381-4e45-92a5-af592c43735f (0913dc4c-d381-4e45-92a5-af592c43735f): created successfully Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5960f3e-e1f0-4818-a209-e481efeb8eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Flow 'volume_create_manager' (7fc8fcb5-92a5-4f64-981c-44eee219b081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-23b8ed2d-4211-472a-a321-68c5314e4376 tempest-VolumesListTestJSON-911409666 None] Created volume successfully. Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Flow 'volume_create_manager' (2b231fee-8f7c-45ea-b4ad-bba6ed292a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea43252c-4361-4c07-bd95-231bd1d21739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea43252c-4361-4c07-bd95-231bd1d21739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1436166384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5669f140-245a-41ad-bf65-a1d318820a9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8adbe3c99cb5400e9081d01608bdeb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:17Z,use_quota=True,user_id='ef62695776914295abbd4a61d3a0081b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8906d5f6-bd1a-4af4-a60f-8b91f91da334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8906d5f6-bd1a-4af4-a60f-8b91f91da334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b590ac13-4f07-4b80-a776-1592078ce354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b590ac13-4f07-4b80-a776-1592078ce354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5669f140-245a-41ad-bf65-a1d318820a9a', 'volume_name': 'volume-5669f140-245a-41ad-bf65-a1d318820a9a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0ee3e2-256d-4794-aa39-665a7a7eaaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0ee3e2-256d-4794-aa39-665a7a7eaaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df414cd-d01b-4765-93a0-1c336ebf79b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:16 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Volume 5669f140-245a-41ad-bf65-a1d318820a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5669f140-245a-41ad-bf65-a1d318820a9a', 'volume_size': 1} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1436166384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5669f140-245a-41ad-bf65-a1d318820a9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8adbe3c99cb5400e9081d01608bdeb98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:17Z,use_quota=True,user_id='ef62695776914295abbd4a61d3a0081b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Creating volume 5669f140-245a-41ad-bf65-a1d318820a9a {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:16 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:16 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a 1073741824 Apr 21 20:58:16 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:17 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a 1073741824" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:17 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a Apr 21 20:58:17 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:17 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a" returned: 0 in 0.438s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df414cd-d01b-4765-93a0-1c336ebf79b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5669f140-245a-41ad-bf65-a1d318820a9a', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7643bfee-7cb2-4cbd-97a7-8408257ad377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:17 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Volume volume-5669f140-245a-41ad-bf65-a1d318820a9a (5669f140-245a-41ad-bf65-a1d318820a9a): created successfully Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7643bfee-7cb2-4cbd-97a7-8408257ad377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:17 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Flow 'volume_create_manager' (2b231fee-8f7c-45ea-b4ad-bba6ed292a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0342af15-5c9b-40a7-86fa-8a685d34fa1a tempest-VolumesListTestJSON-911409666 None] Created volume successfully. Apr 21 20:58:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "cinder-5669f140-245a-41ad-bf65-a1d318820a9a-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-5669f140-245a-41ad-bf65-a1d318820a9a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "cinder-quobyte-5669f140-245a-41ad-bf65-a1d318820a9a" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:20 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-quobyte-5669f140-245a-41ad-bf65-a1d318820a9a" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:20 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[828cea87-f37d-47eb-8257-0f23f1ec6102]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:20 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a Apr 21 20:58:20 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:21 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a" returned: 0 in 0.481s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:21 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a Apr 21 20:58:21 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:21 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5669f140-245a-41ad-bf65-a1d318820a9a" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-quobyte-5669f140-245a-41ad-bf65-a1d318820a9a" released by "delete_volume" :: held 0.929s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Created reservations ['40669ed7-fcd2-4662-885a-45d0fd3b7c1a', 'bfbf3c8d-6008-498b-b2ec-485a26c4533e', '79395228-9077-4d41-83a2-16cebd5af7da', 'a05a6331-23ae-4463-bb10-28f9a032c24b'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:21 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:21 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "cinder-0913dc4c-d381-4e45-92a5-af592c43735f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-0913dc4c-d381-4e45-92a5-af592c43735f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "cinder-quobyte-0913dc4c-d381-4e45-92a5-af592c43735f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-quobyte-0913dc4c-d381-4e45-92a5-af592c43735f" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[8894b4c4-1194-475b-85ed-0e7c04607021]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:21 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f Apr 21 20:58:21 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:22 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.441s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Deleted volume successfully. Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5bec69f4-ad14-4f91-8e48-e75095b1a631 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-5669f140-245a-41ad-bf65-a1d318820a9a-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:22 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:22 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f Apr 21 20:58:22 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:22 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0913dc4c-d381-4e45-92a5-af592c43735f" returned: 0 in 0.413s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-quobyte-0913dc4c-d381-4e45-92a5-af592c43735f" released by "delete_volume" :: held 0.916s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Created reservations ['2b792d4f-131a-4705-b4c0-7a65d4342873', '8ee341b1-943f-4a44-9836-a09fd3b2846d', '4b48fb73-f128-4c1b-b71c-ff20f7b6873d', '0fbee965-02cb-432c-b237-95eb5867eb03'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:22 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:22 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Acquiring lock "cinder-5fcff4cf-934d-4f44-83bd-306865ec5e5c-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Lock "cinder-5fcff4cf-934d-4f44-83bd-306865ec5e5c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:22 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Acquiring lock "cinder-quobyte-5fcff4cf-934d-4f44-83bd-306865ec5e5c" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Lock "cinder-quobyte-5fcff4cf-934d-4f44-83bd-306865ec5e5c" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c1cc57-223b-4193-819a-d11b08230b87]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:23 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c Apr 21 20:58:23 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:23 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Deleted volume successfully. Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5566a3b7-3dff-4ed7-b3af-b1e8b64f04f7 tempest-VolumesListTestJSON-911409666 None] Lock "cinder-0913dc4c-d381-4e45-92a5-af592c43735f-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:23 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c" returned: 0 in 0.481s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:23 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c Apr 21 20:58:23 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:23 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5fcff4cf-934d-4f44-83bd-306865ec5e5c" returned: 0 in 0.394s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Lock "cinder-quobyte-5fcff4cf-934d-4f44-83bd-306865ec5e5c" released by "delete_volume" :: held 0.897s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Created reservations ['1f270df6-8fd5-45d6-81d8-9f1622bf110a', 'dc2c8b6b-fff6-4904-b293-accc281ae86e', '2b4ee261-60ad-4272-a143-23ed9b12c75c', '377888e9-fde4-4d38-8c1d-2546c2315f58'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:23 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:23 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:24 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.444s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:24 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:24 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Deleted volume successfully. Apr 21 20:58:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-733f8dbd-5c7d-49bd-97cd-adb44674b70d tempest-VolumesListTestJSON-911409666 None] Lock "cinder-5fcff4cf-934d-4f44-83bd-306865ec5e5c-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (4ff60896-bac6-4949-951e-2a6fc2b06e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c80edd-d523-4fcc-9665-d6d56217dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c80edd-d523-4fcc-9665-d6d56217dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1817170870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1bef19-f530-4f3d-8a54-dae0d1442bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:32Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4fbea2-11a7-488c-885d-1dce6b44cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e4fbea2-11a7-488c-885d-1dce6b44cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b3416e-aeb2-4938-b6c4-c4c7b98b7f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b3416e-aeb2-4938-b6c4-c4c7b98b7f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1bef19-f530-4f3d-8a54-dae0d1442bce', 'volume_name': 'volume-be1bef19-f530-4f3d-8a54-dae0d1442bce', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7f9eb0-2892-4c6e-bef1-b9023fcfa3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7f9eb0-2892-4c6e-bef1-b9023fcfa3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6972eb9b-044b-4b68-98be-3602ac9986dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:32 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume be1bef19-f530-4f3d-8a54-dae0d1442bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1bef19-f530-4f3d-8a54-dae0d1442bce', 'volume_size': 1} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1817170870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1bef19-f530-4f3d-8a54-dae0d1442bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:32Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating volume be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:32 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:32 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce 1073741824 Apr 21 20:58:32 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:32 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce 1073741824" returned: 0 in 0.506s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:32 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce Apr 21 20:58:32 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:33 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce" returned: 0 in 0.433s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6972eb9b-044b-4b68-98be-3602ac9986dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1bef19-f530-4f3d-8a54-dae0d1442bce', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fe3a9a-d6b9-41ca-ae66-04f1d8ad17f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:33 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume volume-be1bef19-f530-4f3d-8a54-dae0d1442bce (be1bef19-f530-4f3d-8a54-dae0d1442bce): created successfully Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fe3a9a-d6b9-41ca-ae66-04f1d8ad17f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:33 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (4ff60896-bac6-4949-951e-2a6fc2b06e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:33 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c5a33936-f679-4706-a159-3ae20fea0a10 tempest-VolumesSnapshotTestJSON-1899117833 None] Created volume successfully. Apr 21 20:58:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Creating offline snapshot c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 of volume be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:34 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2580d4-87e9-4be2-ab87-f3e4593ca467]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:34 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce Apr 21 20:58:34 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce" returned: 0 in 0.464s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 1G Apr 21 20:58:35 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:35 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 1G" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1bef19-f530-4f3d-8a54-dae0d1442bce -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:35 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1bef19-f530-4f3d-8a54-dae0d1442bce -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 Apr 21 20:58:35 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1bef19-f530-4f3d-8a54-dae0d1442bce -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 is being set with open permissions: ugo+rw Apr 21 20:58:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 Apr 21 20:58:36 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info Apr 21 20:58:36 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:36 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info" returned: 0 in 0.410s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:36 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info is being set with open permissions: ugo+rw Apr 21 20:58:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:36 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info Apr 21 20:58:36 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:37 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.info" returned: 0 in 0.386s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3e655ab7-a944-4708-a3ef-e55def4a2fab tempest-VolumesSnapshotTestJSON-1899117833 None] Create snapshot completed successfully Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-c0b4a9c9-10b6-4e9f-88ca-f28b1a676961-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-c0b4a9c9-10b6-4e9f-88ca-f28b1a676961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-be1bef19-f530-4f3d-8a54-dae0d1442bce" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-be1bef19-f530-4f3d-8a54-dae0d1442bce" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Deleting offline snapshot c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 of volume be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] snapshot_file for this snap is: volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f834d30b-f983-4a44-8a6b-2221efbc2980]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:37 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 Apr 21 20:58:37 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be1bef19-f530-4f3d-8a54-dae0d1442bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac61ec1-3af4-4923-a608-516082825288]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:38 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce Apr 21 20:58:38 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:38 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce" returned: 0 in 0.467s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:38 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 Apr 21 20:58:38 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:39 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961 Apr 21 20:58:39 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:39 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce.c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" returned: 0 in 0.421s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-c0b4a9c9-10b6-4e9f-88ca-f28b1a676961" released by "_delete_snapshot" :: held 1.887s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-be1bef19-f530-4f3d-8a54-dae0d1442bce" released by "delete_snapshot" :: held 1.899s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['b32b77d7-e4d7-41de-8715-ea087376a8de', 'c2a6826b-cd60-4f0f-97d4-0908480109e4', '7594a25c-cf28-4fc7-9533-8f966266c7a8', 'ed531a49-3a9b-4555-a5ef-da7f20185f24'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:39 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Delete snapshot completed successfully. Apr 21 20:58:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1473291c-5aa0-4a6c-86d0-488bbc7416ef tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-c0b4a9c9-10b6-4e9f-88ca-f28b1a676961-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (359cf94f-d87f-43ae-935b-98bacb0ddbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc52a7b-d4ad-4236-966d-8ef186065879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc52a7b-d4ad-4236-966d-8ef186065879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-289521065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d031fdbe-d168-4533-bdf6-6a50c1e4255b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:40Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee238e5c-bc2f-421a-9fe0-0b545b2c8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee238e5c-bc2f-421a-9fe0-0b545b2c8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb1ce24-e6d4-4a14-94c7-432a9f8a2583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb1ce24-e6d4-4a14-94c7-432a9f8a2583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd031fdbe-d168-4533-bdf6-6a50c1e4255b', 'volume_name': 'volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7a2e2a-4237-4bc6-a3db-d3a79e6a1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7a2e2a-4237-4bc6-a3db-d3a79e6a1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175df7d1-e333-4c5e-9580-23ed7085bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:40 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume d031fdbe-d168-4533-bdf6-6a50c1e4255b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b', 'volume_size': 1} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-289521065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d031fdbe-d168-4533-bdf6-6a50c1e4255b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:40Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating volume d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:40 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:40 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b 1073741824 Apr 21 20:58:40 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:40 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b 1073741824" returned: 0 in 0.548s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:40 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:40 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:41 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.444s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175df7d1-e333-4c5e-9580-23ed7085bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5954da49-3c0f-42e7-9333-803c94bed9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:41 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b (d031fdbe-d168-4533-bdf6-6a50c1e4255b): created successfully Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5954da49-3c0f-42e7-9333-803c94bed9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:41 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (359cf94f-d87f-43ae-935b-98bacb0ddbf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6eceda34-165e-4a5a-981c-5d9ae70be742 tempest-VolumesSnapshotTestJSON-1899117833 None] Created volume successfully. Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating offline snapshot 1a03def5-8098-4479-b209-1b0551220dda of volume d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[238875f9-e472-46d2-91a0-b40373a7fb07]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:42 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:42 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:42 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.492s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:42 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda 1G Apr 21 20:58:43 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda 1G" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:43 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda Apr 21 20:58:43 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:43 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:43 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda is being set with open permissions: ugo+rw Apr 21 20:58:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda Apr 21 20:58:44 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:44 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda" returned: 0 in 0.484s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=107,cinder:SELECT=79,cinder:INSERT=28,cinder:DELETE=8 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info Apr 21 20:58:44 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:44 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info" returned: 0 in 0.424s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:44 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info is being set with open permissions: ugo+rw Apr 21 20:58:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:44 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info Apr 21 20:58:44 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:45 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.info" returned: 0 in 0.407s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.848s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4acf2667-5ab8-4ea7-9c7b-1ee6d5a79bc1 tempest-VolumesSnapshotTestJSON-1899117833 None] Create snapshot completed successfully Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (e13d731c-cd3f-437c-b207-a886c404f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f93a940-d17c-4eec-8be0-c4fc019157cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f93a940-d17c-4eec-8be0-c4fc019157cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-381201021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d832d4c3-0b40-454e-895c-1def9faeebeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1a03def5-8098-4479-b209-1b0551220dda,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:46Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411880a3-5156-484a-beab-54afde95134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411880a3-5156-484a-beab-54afde95134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1201ffef-f287-4230-bb2c-d196ddcef477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1201ffef-f287-4230-bb2c-d196ddcef477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd832d4c3-0b40-454e-895c-1def9faeebeb', 'volume_name': 'volume-d832d4c3-0b40-454e-895c-1def9faeebeb', 'volume_size': 2, 'snapshot_id': '1a03def5-8098-4479-b209-1b0551220dda'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ff40a4-9e31-408c-8404-4e4cadf68f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ff40a4-9e31-408c-8404-4e4cadf68f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a77611-5e08-4663-9a1e-2d49bd2a308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume d832d4c3-0b40-454e-895c-1def9faeebeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d832d4c3-0b40-454e-895c-1def9faeebeb', 'volume_size': 2, 'snapshot_id': '1a03def5-8098-4479-b209-1b0551220dda'} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-1a03def5-8098-4479-b209-1b0551220dda-d832d4c3-0b40-454e-895c-1def9faeebeb" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-1a03def5-8098-4479-b209-1b0551220dda-d832d4c3-0b40-454e-895c-1def9faeebeb" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating volume d832d4c3-0b40-454e-895c-1def9faeebeb from snapshot 1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-d832d4c3-0b40-454e-895c-1def9faeebeb" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d832d4c3-0b40-454e-895c-1def9faeebeb" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] snapshot: 1a03def5-8098-4479-b209-1b0551220dda, volume: d832d4c3-0b40-454e-895c-1def9faeebeb, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f4cf8-b6fe-40b7-bd26-2be87e444605]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda Apr 21 20:58:46 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda" returned: 0 in 0.476s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c533e-a3bf-4f6e-b4d9-6f3d49bf536f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:46 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:46 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:46 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:58:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:47 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb Apr 21 20:58:47 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:48 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb" returned: 0 in 1.951s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:48 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58b11d0-ebf7-44be-af4b-89b00238cd6c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:49 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.590s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:58:49 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Converted 1024.00 MB image at 524.31 MB/s Apr 21 20:58:49 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb is being set with open permissions: ugo+rw Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:49 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb Apr 21 20:58:49 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:49 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb" returned: 0 in 0.401s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d832d4c3-0b40-454e-895c-1def9faeebeb" released by "_copy_volume_from_snapshot" :: held 3.969s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-1a03def5-8098-4479-b209-1b0551220dda-d832d4c3-0b40-454e-895c-1def9faeebeb" released by "_create_volume_from_snapshot" :: held 3.988s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.997s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a77611-5e08-4663-9a1e-2d49bd2a308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d832d4c3-0b40-454e-895c-1def9faeebeb', 'volume_size': 2, 'snapshot_id': '1a03def5-8098-4479-b209-1b0551220dda'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe33ef6-d332-470d-b365-328f8efc58e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:49 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume volume-d832d4c3-0b40-454e-895c-1def9faeebeb (d832d4c3-0b40-454e-895c-1def9faeebeb): created successfully Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe33ef6-d332-470d-b365-328f8efc58e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (e13d731c-cd3f-437c-b207-a886c404f638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0326f92b-c5c4-4b49-8528-6c1b72805ab3 tempest-VolumesSnapshotTestJSON-1899117833 None] Created volume successfully. Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-d832d4c3-0b40-454e-895c-1def9faeebeb-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-d832d4c3-0b40-454e-895c-1def9faeebeb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-d832d4c3-0b40-454e-895c-1def9faeebeb" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d832d4c3-0b40-454e-895c-1def9faeebeb" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9389b8b-2a13-4f55-a736-2e056be1f38d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb Apr 21 20:58:50 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:50 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:50 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb Apr 21 20:58:50 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d832d4c3-0b40-454e-895c-1def9faeebeb" returned: 0 in 0.390s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d832d4c3-0b40-454e-895c-1def9faeebeb" released by "delete_volume" :: held 0.863s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['9e0949a3-8241-4f10-a591-3292944e53f4', 'a46b3cbd-f623-40c2-8870-29b4a48497f5', 'd4530cb1-252d-482e-8eaf-efd314d23110', '812f9be0-a77e-47a5-8583-e811ca4a5519'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:51 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-1a03def5-8098-4479-b209-1b0551220dda-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-1a03def5-8098-4479-b209-1b0551220dda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-d031fdbe-d168-4533-bdf6-6a50c1e4255b" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d031fdbe-d168-4533-bdf6-6a50c1e4255b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-1a03def5-8098-4479-b209-1b0551220dda" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-1a03def5-8098-4479-b209-1b0551220dda" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Deleting offline snapshot 1a03def5-8098-4479-b209-1b0551220dda of volume d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] snapshot_file for this snap is: volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4793f97-532b-47f3-9833-a457f1a29d22]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda Apr 21 20:58:51 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:51 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.446s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:51 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Deleted volume successfully. Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-2ba885d0-c3cf-4aa3-ae6f-ea4b1fc5906e tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-d832d4c3-0b40-454e-895c-1def9faeebeb-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:51 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:51 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5b04df-854e-49c7-a6f4-c3a02bda16c2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:52 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.393s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:52 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.465s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda Apr 21 20:58:52 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:52 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda" returned: 0 in 0.436s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:52 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda Apr 21 20:58:52 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:53 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b.1a03def5-8098-4479-b209-1b0551220dda" returned: 0 in 0.394s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-1a03def5-8098-4479-b209-1b0551220dda" released by "_delete_snapshot" :: held 1.813s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d031fdbe-d168-4533-bdf6-6a50c1e4255b" released by "delete_snapshot" :: held 1.824s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['bfb63922-02f8-4196-8b25-43257519e3f9', '53b452d1-1b50-4ff2-880f-fd3feebc1b99', 'af521b3b-1d8a-467c-adf6-877a206a378f', '6d1bdcec-9baa-4c32-a1df-82ee5f802860'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Delete snapshot completed successfully. Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-43e76234-8131-4a30-97be-187332310daa tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-1a03def5-8098-4479-b209-1b0551220dda-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-d031fdbe-d168-4533-bdf6-6a50c1e4255b-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-d031fdbe-d168-4533-bdf6-6a50c1e4255b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-d031fdbe-d168-4533-bdf6-6a50c1e4255b" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d031fdbe-d168-4533-bdf6-6a50c1e4255b" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[daccd644-c90b-46e5-ba05-b3dc858cd3a5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:53 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:53 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.458s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b Apr 21 20:58:54 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:54 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d031fdbe-d168-4533-bdf6-6a50c1e4255b" returned: 0 in 0.396s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-d031fdbe-d168-4533-bdf6-6a50c1e4255b" released by "delete_volume" :: held 0.882s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['8c010bb5-4ea9-46d0-b62a-9a58e98386fb', 'b0e03484-b122-41c7-937f-0b56b1803cce', '114725a7-1600-414c-8609-6b243101273d', 'ece41a77-3c5f-4dc7-8358-23a88604458c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:54 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:58:54 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (85c1b23e-0897-493a-9cf3-ef338aa961de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055ef0c1-3b05-4d2a-a4dd-4aa61746954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055ef0c1-3b05-4d2a-a4dd-4aa61746954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2033319757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8571765f-e5a1-4d73-beec-1d4fdf04fe39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:55Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8567bdcd-06d0-401a-b4f6-a8aa3f8c60ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8567bdcd-06d0-401a-b4f6-a8aa3f8c60ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588c375c-fa9d-4346-971d-125bec7711a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588c375c-fa9d-4346-971d-125bec7711a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8571765f-e5a1-4d73-beec-1d4fdf04fe39', 'volume_name': 'volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1919f09a-0bb5-42b2-869b-fdbb7fefd1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1919f09a-0bb5-42b2-869b-fdbb7fefd1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f308307-b320-4c13-a2b2-0cf53a7891d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:55 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Volume 8571765f-e5a1-4d73-beec-1d4fdf04fe39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39', 'volume_size': 1} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2033319757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8571765f-e5a1-4d73-beec-1d4fdf04fe39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:58:55Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Creating volume 8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:58:55 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.483s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:58:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Deleted volume successfully. Apr 21 20:58:55 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 1073741824 Apr 21 20:58:55 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-77b7b197-000f-46d3-8e2a-2bc413395e60 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-d031fdbe-d168-4533-bdf6-6a50c1e4255b-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:58:55 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 1073741824" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=105,cinder:INSERT=39,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:58:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:55 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:58:55 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:56 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.456s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f308307-b320-4c13-a2b2-0cf53a7891d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b65f8-8462-4e25-8f92-fdec43608a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:58:56 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Volume volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 (8571765f-e5a1-4d73-beec-1d4fdf04fe39): created successfully Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1b65f8-8462-4e25-8f92-fdec43608a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:58:56 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (85c1b23e-0897-493a-9cf3-ef338aa961de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:58:56 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4e3ed618-8f1e-491f-99e4-f88bd6e84fcb tempest-VolumesSnapshotTestJSON-1899117833 None] Created volume successfully. Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Creating offline snapshot 03141e81-cf3b-4dd4-95ca-882276fc2699 of volume 8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[22efe3c6-cd4e-45d2-869d-4195bc3f1a2c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:57 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:58:57 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:57 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.493s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:57 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 1G Apr 21 20:58:57 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 1G" returned: 0 in 0.489s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 Apr 21 20:58:58 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:58 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699" returned: 0 in 0.434s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:58 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 is being set with open permissions: ugo+rw Apr 21 20:58:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:58 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 Apr 21 20:58:58 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info Apr 21 20:58:59 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:58:59 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 21 20:58:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:58:59 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info is being set with open permissions: ugo+rw Apr 21 20:58:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:58:59 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info Apr 21 20:58:59 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:00 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.info" returned: 0 in 0.429s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.822s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:00 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-15d198fb-c38f-4fb1-8729-423c55ffff7b tempest-VolumesSnapshotTestJSON-1899117833 None] Create snapshot completed successfully Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (4da14ad3-db32-482e-9b51-133920026efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea1bf44-1591-46c8-9487-21cd452954d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea1bf44-1591-46c8-9487-21cd452954d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1382073069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669c696f-b9aa-4677-9742-525197d3c9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562558e20c144e7eaff8c50b8ead0df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03141e81-cf3b-4dd4-95ca-882276fc2699,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:01Z,use_quota=True,user_id='b6dadf2b76704f6fa26a3cce5cd69905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae44826-001e-4948-b52b-dd1a3fb3660f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae44826-001e-4948-b52b-dd1a3fb3660f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938a1aaa-153d-415c-b744-f169ff83d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938a1aaa-153d-415c-b744-f169ff83d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '669c696f-b9aa-4677-9742-525197d3c9a9', 'volume_name': 'volume-669c696f-b9aa-4677-9742-525197d3c9a9', 'volume_size': 1, 'snapshot_id': '03141e81-cf3b-4dd4-95ca-882276fc2699'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6354754-4da7-485f-b3ed-52a7a8701b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6354754-4da7-485f-b3ed-52a7a8701b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596c5a2d-7d7f-419b-ab8c-c0880f38439e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:00 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume 669c696f-b9aa-4677-9742-525197d3c9a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-669c696f-b9aa-4677-9742-525197d3c9a9', 'volume_size': 1, 'snapshot_id': '03141e81-cf3b-4dd4-95ca-882276fc2699'} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-03141e81-cf3b-4dd4-95ca-882276fc2699-669c696f-b9aa-4677-9742-525197d3c9a9" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-03141e81-cf3b-4dd4-95ca-882276fc2699-669c696f-b9aa-4677-9742-525197d3c9a9" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating volume 669c696f-b9aa-4677-9742-525197d3c9a9 from snapshot 03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-669c696f-b9aa-4677-9742-525197d3c9a9" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-669c696f-b9aa-4677-9742-525197d3c9a9" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] snapshot: 03141e81-cf3b-4dd4-95ca-882276fc2699, volume: 669c696f-b9aa-4677-9742-525197d3c9a9, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c30979-a0f7-4161-be10-228f417b3602]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:00 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 Apr 21 20:59:00 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:01 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699" returned: 0 in 0.531s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae348cea-9a50-4db2-a544-62ae646ce5fb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:01 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:59:01 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:01 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.507s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:59:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:01 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 Apr 21 20:59:01 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:03 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9" returned: 0 in 1.983s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:03 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52fbebe-a7e9-44cc-b113-4b8de22250b2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:03 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:59:03 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.609s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39, size 1024.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:59:04 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Converted 1024.00 MB image at 516.13 MB/s Apr 21 20:59:04 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 is being set with open permissions: ugo+rw Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:04 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 Apr 21 20:59:04 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:04 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9" returned: 0 in 0.417s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-669c696f-b9aa-4677-9742-525197d3c9a9" released by "_copy_volume_from_snapshot" :: held 4.108s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-03141e81-cf3b-4dd4-95ca-882276fc2699-669c696f-b9aa-4677-9742-525197d3c9a9" released by "_create_volume_from_snapshot" :: held 4.126s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.135s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596c5a2d-7d7f-419b-ab8c-c0880f38439e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669c696f-b9aa-4677-9742-525197d3c9a9', 'volume_size': 1, 'snapshot_id': '03141e81-cf3b-4dd4-95ca-882276fc2699'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c964eeb0-8e54-4f90-8636-637ceb58619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:04 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Volume volume-669c696f-b9aa-4677-9742-525197d3c9a9 (669c696f-b9aa-4677-9742-525197d3c9a9): created successfully Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c964eeb0-8e54-4f90-8636-637ceb58619d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Flow 'volume_create_manager' (4da14ad3-db32-482e-9b51-133920026efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7790c982-79d9-4b79-a67b-f0784d2efa84 tempest-VolumesSnapshotTestJSON-1899117833 None] Created volume successfully. Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-669c696f-b9aa-4677-9742-525197d3c9a9-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-669c696f-b9aa-4677-9742-525197d3c9a9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-669c696f-b9aa-4677-9742-525197d3c9a9" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-669c696f-b9aa-4677-9742-525197d3c9a9" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c7eea-6539-4083-8b5c-66915156caa2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 Apr 21 20:59:06 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:06 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9 Apr 21 20:59:06 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:06 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-669c696f-b9aa-4677-9742-525197d3c9a9" returned: 0 in 0.395s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-669c696f-b9aa-4677-9742-525197d3c9a9" released by "delete_volume" :: held 0.881s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['e193067c-49e9-4e1f-bde4-661cad00cb67', 'ce2a0336-36bf-478a-a119-8dc68506cd2d', 'c913b36f-8471-4ff5-afff-7ba8a7143592', '1d9fe628-8746-40b0-b456-f24ca9328229'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:07 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-03141e81-cf3b-4dd4-95ca-882276fc2699-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-03141e81-cf3b-4dd4-95ca-882276fc2699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-8571765f-e5a1-4d73-beec-1d4fdf04fe39" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-8571765f-e5a1-4d73-beec-1d4fdf04fe39" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-03141e81-cf3b-4dd4-95ca-882276fc2699" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-03141e81-cf3b-4dd4-95ca-882276fc2699" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Deleting offline snapshot 03141e81-cf3b-4dd4-95ca-882276fc2699 of volume 8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] snapshot_file for this snap is: volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cc9919-8de0-4c3e-8553-09bab72f25e1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 Apr 21 20:59:07 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:07 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.410s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:07 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Deleted volume successfully. Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4b19636e-2d3a-4c96-887c-8940bbabaf9d tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-669c696f-b9aa-4677-9742-525197d3c9a9-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:07 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699" returned: 0 in 0.490s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[59703dd6-52cd-43c6-af86-73516cbaa307]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:07 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:59:07 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.454s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 Apr 21 20:59:08 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699" returned: 0 in 0.426s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:08 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699 Apr 21 20:59:08 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:08 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39.03141e81-cf3b-4dd4-95ca-882276fc2699" returned: 0 in 0.388s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-03141e81-cf3b-4dd4-95ca-882276fc2699" released by "_delete_snapshot" :: held 1.811s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-8571765f-e5a1-4d73-beec-1d4fdf04fe39" released by "delete_snapshot" :: held 1.824s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['d9fcc24c-51a2-455a-8c07-423ed2d06c2c', '3ea7041d-4373-4908-be2f-8c700bd5968f', 'd1416c83-4964-4f44-8571-298279386361', 'b2b04430-8279-4508-adc8-414df8882ca1'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Delete snapshot completed successfully. Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-71d4aed3-a3dc-41a4-805a-d74a531e2828 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-03141e81-cf3b-4dd4-95ca-882276fc2699-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-8571765f-e5a1-4d73-beec-1d4fdf04fe39-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-8571765f-e5a1-4d73-beec-1d4fdf04fe39-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-8571765f-e5a1-4d73-beec-1d4fdf04fe39" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-8571765f-e5a1-4d73-beec-1d4fdf04fe39" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[488bd01d-266e-43c8-9492-412a60fa1fc8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:59:09 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:09 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.446s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:09 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39 Apr 21 20:59:09 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:10 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8571765f-e5a1-4d73-beec-1d4fdf04fe39" returned: 0 in 0.388s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-8571765f-e5a1-4d73-beec-1d4fdf04fe39" released by "delete_volume" :: held 0.859s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['95b8c10f-6057-4d41-9eab-6c09888dbdfd', 'c6febf80-f396-4328-a687-7afaadd952c1', '10685409-6e80-458d-9c43-0b2d1eedc02e', '8744d895-da19-4500-a4fd-33df715a0564'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:10 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-be1bef19-f530-4f3d-8a54-dae0d1442bce-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-be1bef19-f530-4f3d-8a54-dae0d1442bce-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "cinder-quobyte-be1bef19-f530-4f3d-8a54-dae0d1442bce" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-be1bef19-f530-4f3d-8a54-dae0d1442bce" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e60059-80b0-4c7c-bb96-e1813535beda]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:10 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce Apr 21 20:59:10 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:10 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.397s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Deleted volume successfully. Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4aebf37a-bd03-4da6-b76f-cc6f3d988b31 tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-8571765f-e5a1-4d73-beec-1d4fdf04fe39-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:10 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce Apr 21 20:59:11 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-be1bef19-f530-4f3d-8a54-dae0d1442bce" returned: 0 in 0.393s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-quobyte-be1bef19-f530-4f3d-8a54-dae0d1442bce" released by "delete_volume" :: held 0.873s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Created reservations ['202a9600-003d-47a7-ae2c-3608ba62aaf5', '0a505f42-7038-4845-baae-b8965c079dc4', 'bd5644ea-fe4b-413d-89be-af7047a39a2a', '20ee777e-ca9a-475d-8112-69a8e159a96d'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:11 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:11 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:11 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.397s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Deleted volume successfully. Apr 21 20:59:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5af121a7-64af-4b31-95f9-504b8820324f tempest-VolumesSnapshotTestJSON-1899117833 None] Lock "cinder-be1bef19-f530-4f3d-8a54-dae0d1442bce-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (1b055a4d-402e-4ae4-bcd8-dde7380a31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0da0d7-5ad3-489f-9d98-5bad2ab0be99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0da0d7-5ad3-489f-9d98-5bad2ab0be99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1595022742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e33668-1c07-40bb-b48b-7b884e20a305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5770948136ad43438aefc487d7655f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:15Z,use_quota=True,user_id='91925f6860a649e29851e11fdf54914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4553df-a546-453d-b94d-cd44b5f525d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e4553df-a546-453d-b94d-cd44b5f525d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189cb886-9483-4388-ae67-408f2f57d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189cb886-9483-4388-ae67-408f2f57d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e33668-1c07-40bb-b48b-7b884e20a305', 'volume_name': 'volume-d5e33668-1c07-40bb-b48b-7b884e20a305', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd63eba-a77c-4855-bf09-a257ffd68610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd63eba-a77c-4855-bf09-a257ffd68610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23710260-ecc2-4651-81c3-e531a8862ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Volume d5e33668-1c07-40bb-b48b-7b884e20a305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e33668-1c07-40bb-b48b-7b884e20a305', 'volume_size': 1} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1595022742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e33668-1c07-40bb-b48b-7b884e20a305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5770948136ad43438aefc487d7655f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:15Z,use_quota=True,user_id='91925f6860a649e29851e11fdf54914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Creating volume d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:15 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 1073741824 Apr 21 20:59:15 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 1073741824" returned: 0 in 0.436s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:15 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:15 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:15 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.380s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23710260-ecc2-4651-81c3-e531a8862ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e33668-1c07-40bb-b48b-7b884e20a305', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824d650d-127f-477c-9fe0-be7d1d5c6c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Volume volume-d5e33668-1c07-40bb-b48b-7b884e20a305 (d5e33668-1c07-40bb-b48b-7b884e20a305): created successfully Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824d650d-127f-477c-9fe0-be7d1d5c6c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (1b055a4d-402e-4ae4-bcd8-dde7380a31ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:15 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-adc721b9-d902-4f4f-ac99-37e95acfc6f4 tempest-VolumeDependencyTests-477596004 None] Created volume successfully. Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Creating offline snapshot 983afeec-9c2c-4179-adc5-debea9336e6e of volume d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9443d8-1cc4-4ef1-a34c-1fcf1b8070ae]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:16 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:16 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:16 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:16 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e 1G Apr 21 20:59:16 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e 1G" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e33668-1c07-40bb-b48b-7b884e20a305 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e33668-1c07-40bb-b48b-7b884e20a305 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e Apr 21 20:59:17 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e33668-1c07-40bb-b48b-7b884e20a305 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e" returned: 0 in 0.398s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:17 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e is being set with open permissions: ugo+rw Apr 21 20:59:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e Apr 21 20:59:17 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:17 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e" returned: 0 in 0.380s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:17 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info Apr 21 20:59:17 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info" returned: 0 in 0.389s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info is being set with open permissions: ugo+rw Apr 21 20:59:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:18 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info Apr 21 20:59:18 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:18 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.info" returned: 0 in 0.387s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f5251df1-ca56-4031-a1ac-db99c185edc8 tempest-VolumeDependencyTests-477596004 None] Create snapshot completed successfully Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (bf5af8eb-c717-41ce-bc66-7a9facd06736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbfd573-5d3e-43f4-b8ce-dec12c115e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbfd573-5d3e-43f4-b8ce-dec12c115e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1814301324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc15f762-0795-4cc3-880d-19cfd6c4c879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5770948136ad43438aefc487d7655f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=983afeec-9c2c-4179-adc5-debea9336e6e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:20Z,use_quota=True,user_id='91925f6860a649e29851e11fdf54914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd69e6-a9d2-468e-865e-bf28410e0e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd69e6-a9d2-468e-865e-bf28410e0e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3a8182-c5af-402a-8628-a515f2f87270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3a8182-c5af-402a-8628-a515f2f87270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc15f762-0795-4cc3-880d-19cfd6c4c879', 'volume_name': 'volume-fc15f762-0795-4cc3-880d-19cfd6c4c879', 'volume_size': 1, 'snapshot_id': '983afeec-9c2c-4179-adc5-debea9336e6e'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39848e36-6d83-4fab-8b1e-f1d70dac0823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39848e36-6d83-4fab-8b1e-f1d70dac0823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749eb75a-9582-42c8-8b7a-ff9f28fd081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:19 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Volume fc15f762-0795-4cc3-880d-19cfd6c4c879: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc15f762-0795-4cc3-880d-19cfd6c4c879', 'volume_size': 1, 'snapshot_id': '983afeec-9c2c-4179-adc5-debea9336e6e'} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-983afeec-9c2c-4179-adc5-debea9336e6e-fc15f762-0795-4cc3-880d-19cfd6c4c879" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-983afeec-9c2c-4179-adc5-debea9336e6e-fc15f762-0795-4cc3-880d-19cfd6c4c879" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Creating volume fc15f762-0795-4cc3-880d-19cfd6c4c879 from snapshot 983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-fc15f762-0795-4cc3-880d-19cfd6c4c879" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-fc15f762-0795-4cc3-880d-19cfd6c4c879" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] snapshot: 983afeec-9c2c-4179-adc5-debea9336e6e, volume: fc15f762-0795-4cc3-880d-19cfd6c4c879, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b366e3f-d24e-40de-bbe8-d54e19dbecac]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:19 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e Apr 21 20:59:19 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:20 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e" returned: 0 in 0.448s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e33668-1c07-40bb-b48b-7b884e20a305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df878be-661c-4ecd-ad74-983a1e313126]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:20 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:20 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:20 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:59:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:20 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 Apr 21 20:59:20 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879" returned: 0 in 1.703s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5b03e6-6909-4ef5-b7d6-c227c7d45cde]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:22 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:22 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.559s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:22 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305, size 1024.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:59:22 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Converted 1024.00 MB image at 600.73 MB/s Apr 21 20:59:22 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 is being set with open permissions: ugo+rw Apr 21 20:59:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:22 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 Apr 21 20:59:22 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:23 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879" returned: 0 in 0.396s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-fc15f762-0795-4cc3-880d-19cfd6c4c879" released by "_copy_volume_from_snapshot" :: held 3.608s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-983afeec-9c2c-4179-adc5-debea9336e6e-fc15f762-0795-4cc3-880d-19cfd6c4c879" released by "_create_volume_from_snapshot" :: held 3.622s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.629s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749eb75a-9582-42c8-8b7a-ff9f28fd081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc15f762-0795-4cc3-880d-19cfd6c4c879', 'volume_size': 1, 'snapshot_id': '983afeec-9c2c-4179-adc5-debea9336e6e'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89edca2f-76d1-437f-800b-2b2397902ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:23 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Volume volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 (fc15f762-0795-4cc3-880d-19cfd6c4c879): created successfully Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89edca2f-76d1-437f-800b-2b2397902ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (bf5af8eb-c717-41ce-bc66-7a9facd06736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c0b3704f-abab-4ecd-844a-955f271adcb6 tempest-VolumeDependencyTests-477596004 None] Created volume successfully. Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-983afeec-9c2c-4179-adc5-debea9336e6e-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-983afeec-9c2c-4179-adc5-debea9336e6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-d5e33668-1c07-40bb-b48b-7b884e20a305" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-d5e33668-1c07-40bb-b48b-7b884e20a305" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-983afeec-9c2c-4179-adc5-debea9336e6e" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-983afeec-9c2c-4179-adc5-debea9336e6e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Deleting offline snapshot 983afeec-9c2c-4179-adc5-debea9336e6e of volume d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] snapshot_file for this snap is: volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd15e1f-99ac-4b91-960a-222ec9fe02ae]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:23 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e Apr 21 20:59:23 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:24 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e" returned: 0 in 0.445s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e33668-1c07-40bb-b48b-7b884e20a305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:24 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d1782-a11a-4c01-a0a7-ce48063492b2]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:24 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:24 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:24 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.449s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:24 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e Apr 21 20:59:24 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:25 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e" returned: 0 in 0.428s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:25 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e Apr 21 20:59:25 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:25 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305.983afeec-9c2c-4179-adc5-debea9336e6e" returned: 0 in 0.385s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-983afeec-9c2c-4179-adc5-debea9336e6e" released by "_delete_snapshot" :: held 1.758s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-d5e33668-1c07-40bb-b48b-7b884e20a305" released by "delete_snapshot" :: held 1.775s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Created reservations ['51068cd9-df43-4751-afb7-ba5e48310322', '647d7d95-403e-4ba9-a3c2-fb9b87b5a5db', '188fe600-093e-48dd-901c-d028059dae54', '041026d0-363b-4302-a4f0-9c33f967a893'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:25 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Delete snapshot completed successfully. Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8ad8418b-be3c-4406-96f8-13ecbbb11c41 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-983afeec-9c2c-4179-adc5-debea9336e6e-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-d5e33668-1c07-40bb-b48b-7b884e20a305-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-d5e33668-1c07-40bb-b48b-7b884e20a305-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-d5e33668-1c07-40bb-b48b-7b884e20a305" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-d5e33668-1c07-40bb-b48b-7b884e20a305" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d32957b-5de1-4406-8f08-9a4f8ba8d306]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:26 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:26 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.436s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305 Apr 21 20:59:26 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:26 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d5e33668-1c07-40bb-b48b-7b884e20a305" returned: 0 in 0.382s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-d5e33668-1c07-40bb-b48b-7b884e20a305" released by "delete_volume" :: held 0.845s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Created reservations ['119d0db3-55f3-48ae-8ab9-23a69ba5805b', '90c77fad-12d2-4da4-ba55-6401e51ca42e', '2dcf027a-ccf1-43c6-be5a-2434fb4a1fec', '3afc50f0-3d0f-4b18-bea2-9d0aad4546c0'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:26 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:26 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (159976e0-6e06-4796-af5f-99a6b36c0aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d55d34c-6d5e-4ffe-9c1b-7fa0171290d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d55d34c-6d5e-4ffe-9c1b-7fa0171290d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-645549408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0f096e-748b-42fa-8ce9-8e7acac32a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5770948136ad43438aefc487d7655f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='91925f6860a649e29851e11fdf54914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6deaeb55-1edb-49bb-bc8a-d31165741233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6deaeb55-1edb-49bb-bc8a-d31165741233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81268d4f-b281-446d-8167-a3713ffd0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81268d4f-b281-446d-8167-a3713ffd0075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'volume_name': 'volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd8962c-7f41-4f35-b9b7-3cf638160f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bd8962c-7f41-4f35-b9b7-3cf638160f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe32f40-1125-463d-9482-93dc7fbc0934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:27 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Volume 7e0f096e-748b-42fa-8ce9-8e7acac32a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'volume_size': 1} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-645549408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0f096e-748b-42fa-8ce9-8e7acac32a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5770948136ad43438aefc487d7655f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:27Z,use_quota=True,user_id='91925f6860a649e29851e11fdf54914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Creating volume 7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:27 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.464s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:27 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Deleted volume successfully. Apr 21 20:59:27 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 1073741824 Apr 21 20:59:27 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a2b6f02d-27b2-4313-b2d5-33a1347f3999 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-d5e33668-1c07-40bb-b48b-7b884e20a305-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:27 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 1073741824" returned: 0 in 0.454s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:27 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:27 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:28 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.384s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfe32f40-1125-463d-9482-93dc7fbc0934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b5788f-154d-4129-9056-1995e00234c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Volume volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 (7e0f096e-748b-42fa-8ce9-8e7acac32a93): created successfully Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b5788f-154d-4129-9056-1995e00234c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (159976e0-6e06-4796-af5f-99a6b36c0aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:28 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1b2da7c0-e125-48d5-824e-8c812ae9b1ff tempest-VolumeDependencyTests-477596004 None] Created volume successfully. Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (dcd400f9-a119-4309-91b4-6a28808530cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19244c9-abc3-4cf3-b601-d27457fde050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19244c9-abc3-4cf3-b601-d27457fde050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-95208011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4220aa49-de9a-4194-9847-86ecc1e36693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5770948136ad43438aefc487d7655f47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7e0f096e-748b-42fa-8ce9-8e7acac32a93,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:29Z,use_quota=True,user_id='91925f6860a649e29851e11fdf54914c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe03102-63ef-4162-8e2e-db85446ada55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe03102-63ef-4162-8e2e-db85446ada55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff5575b-6080-4639-8210-5c5574f07fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff5575b-6080-4639-8210-5c5574f07fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4220aa49-de9a-4194-9847-86ecc1e36693', 'volume_name': 'volume-4220aa49-de9a-4194-9847-86ecc1e36693', 'volume_size': 1, 'source_volid': '7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b2a492-9f4d-433b-97ee-7224390c9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b2a492-9f4d-433b-97ee-7224390c9f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d20e3a-2719-4bec-bf5e-d23ec6543977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:28 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Volume 4220aa49-de9a-4194-9847-86ecc1e36693: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4220aa49-de9a-4194-9847-86ecc1e36693', 'volume_size': 1, 'source_volid': '7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'source_volstatus': 'available'} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:28 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Cloning volume 7e0f096e-748b-42fa-8ce9-8e7acac32a93 to volume 4220aa49-de9a-4194-9847-86ecc1e36693 Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Creating offline snapshot 8ea027bf-2485-4ad7-93c2-f97291965ddd of volume 7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b8cd07-9e4c-433f-a4de-ce5f3434af45]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:28 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:28 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:29 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd 1G Apr 21 20:59:29 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:29 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd 1G" returned: 0 in 0.446s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:29 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd Apr 21 20:59:29 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd" returned: 0 in 0.405s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd is being set with open permissions: ugo+rw Apr 21 20:59:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd Apr 21 20:59:30 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd" returned: 0 in 0.385s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info Apr 21 20:59:30 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:30 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info" returned: 0 in 0.402s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:30 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info is being set with open permissions: ugo+rw Apr 21 20:59:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:30 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info Apr 21 20:59:30 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.info" returned: 0 in 0.382s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-4220aa49-de9a-4194-9847-86ecc1e36693" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-4220aa49-de9a-4194-9847-86ecc1e36693" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] snapshot: 8ea027bf-2485-4ad7-93c2-f97291965ddd, volume: 4220aa49-de9a-4194-9847-86ecc1e36693, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba73182-af8a-4501-8826-eae3b4b0a5d0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd Apr 21 20:59:31 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:31 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd" returned: 0 in 0.459s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa01b6-3b0b-4db4-8627-69ac6ced7df6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:31 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:31 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:32 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.456s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:32 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 20:59:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:32 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 Apr 21 20:59:32 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:33 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693" returned: 0 in 1.721s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4975115-3c79-4a08-96cf-15d6c3886e8b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:33 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:33 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.552s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93, size 1024.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 20:59:34 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Converted 1024.00 MB image at 594.67 MB/s Apr 21 20:59:34 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 is being set with open permissions: ugo+rw Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 Apr 21 20:59:34 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:34 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693" returned: 0 in 0.382s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-4220aa49-de9a-4194-9847-86ecc1e36693" released by "_copy_volume_from_snapshot" :: held 3.610s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-8ea027bf-2485-4ad7-93c2-f97291965ddd" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-8ea027bf-2485-4ad7-93c2-f97291965ddd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Deleting offline snapshot 8ea027bf-2485-4ad7-93c2-f97291965ddd of volume 7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] snapshot_file for this snap is: volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6adf90-cc53-41cc-8ed2-85db36420ca1]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:34 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd Apr 21 20:59:34 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd" returned: 0 in 0.445s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 20:59:35 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2d0460-e460-4b9e-9cc9-500f899f16da]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:35 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:35 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.438s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:35 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd Apr 21 20:59:35 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd" returned: 0 in 0.416s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:36 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd Apr 21 20:59:36 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:36 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93.8ea027bf-2485-4ad7-93c2-f97291965ddd" returned: 0 in 0.388s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-8ea027bf-2485-4ad7-93c2-f97291965ddd" released by "_delete_snapshot" :: held 1.728s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 7.910s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d20e3a-2719-4bec-bf5e-d23ec6543977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4220aa49-de9a-4194-9847-86ecc1e36693', 'volume_size': 1, 'source_volid': '7e0f096e-748b-42fa-8ce9-8e7acac32a93', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c94320c-048f-419a-a2b4-09c4f5d7dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:36 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Volume volume-4220aa49-de9a-4194-9847-86ecc1e36693 (4220aa49-de9a-4194-9847-86ecc1e36693): created successfully Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c94320c-048f-419a-a2b4-09c4f5d7dde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:36 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Flow 'volume_create_manager' (dcd400f9-a119-4309-91b4-6a28808530cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:36 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b7a8c90c-3eb1-4918-8052-420885d586a0 tempest-VolumeDependencyTests-477596004 None] Created volume successfully. Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-7e0f096e-748b-42fa-8ce9-8e7acac32a93-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-7e0f096e-748b-42fa-8ce9-8e7acac32a93-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-7e0f096e-748b-42fa-8ce9-8e7acac32a93" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-7e0f096e-748b-42fa-8ce9-8e7acac32a93" acquired by "delete_volume" :: waited 0.006s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d11e5d-4990-48d0-8fe6-295be6b2bedc]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:37 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:37 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:37 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.435s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:37 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93 Apr 21 20:59:37 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:37 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7e0f096e-748b-42fa-8ce9-8e7acac32a93" returned: 0 in 0.383s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-7e0f096e-748b-42fa-8ce9-8e7acac32a93" released by "delete_volume" :: held 0.851s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:37 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Created reservations ['1ebf582e-b4ee-4d67-b5a7-31fc3d129ac8', 'ee90036d-ddaa-4d98-ba6c-81de71f47407', '9a31e20a-9802-426b-a621-051d7ed33ae5', 'a7b89cf2-d502-4560-b5b1-3c558fb65c02'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:38 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-4220aa49-de9a-4194-9847-86ecc1e36693-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-4220aa49-de9a-4194-9847-86ecc1e36693-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-4220aa49-de9a-4194-9847-86ecc1e36693" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-4220aa49-de9a-4194-9847-86ecc1e36693" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[347fb524-d882-44ab-a2a3-7a7f32ad0fda]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 Apr 21 20:59:38 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:38 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.416s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:38 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Deleted volume successfully. Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-626565fd-d5bc-4356-bc08-f9df851d7d44 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-7e0f096e-748b-42fa-8ce9-8e7acac32a93-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:38 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693" returned: 0 in 0.477s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:38 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693 Apr 21 20:59:38 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4220aa49-de9a-4194-9847-86ecc1e36693" returned: 0 in 0.384s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-4220aa49-de9a-4194-9847-86ecc1e36693" released by "delete_volume" :: held 0.885s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Created reservations ['8da4e56d-c742-499f-beb5-788e050dbad8', 'a0654f2b-fc32-46df-82b3-1096054537bb', '8d3fa291-e1a9-4892-8e29-90046578ff35', '58dffcfc-468b-4da1-867c-de8df617b450'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:39 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-fc15f762-0795-4cc3-880d-19cfd6c4c879-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Lock "cinder-fc15f762-0795-4cc3-880d-19cfd6c4c879-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Acquiring lock "cinder-quobyte-fc15f762-0795-4cc3-880d-19cfd6c4c879" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-fc15f762-0795-4cc3-880d-19cfd6c4c879" acquired by "delete_volume" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb67cd7-c6ab-41ec-97c3-5613586a54e3]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 Apr 21 20:59:39 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:39 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.395s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:39 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Deleted volume successfully. Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fcb17a1f-f3c1-4abe-9f6c-8509364cee69 tempest-VolumeDependencyTests-477596004 None] Lock "cinder-4220aa49-de9a-4194-9847-86ecc1e36693-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:39 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:39 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879 Apr 21 20:59:39 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:40 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc15f762-0795-4cc3-880d-19cfd6c4c879" returned: 0 in 0.384s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Lock "cinder-quobyte-fc15f762-0795-4cc3-880d-19cfd6c4c879" released by "delete_volume" :: held 0.855s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Created reservations ['6d7ce8dc-42ef-4c79-be9b-abfa8bf757a6', '2f5f91d5-7a73-4293-a093-2d2e7c60d561', '44de36cb-459b-4832-8250-ddfa9c00a505', '76f0b078-0329-4dc3-8e98-89a6051f5534'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:40 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:40 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:40 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Deleted volume successfully. Apr 21 20:59:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a7c35a13-1eec-48e2-aea4-0235de334dbe tempest-VolumeDependencyTests-477596004 None] Lock "cinder-fc15f762-0795-4cc3-880d-19cfd6c4c879-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=94,cinder:DELETE=9,cinder:UPDATE=113,cinder:INSERT=31 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (759c87d5-fc31-4760-b649-a2291bcbf06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d33fcf8-ce20-4637-838e-f03d1754b0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d33fcf8-ce20-4637-838e-f03d1754b0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844597995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75e1b3-860d-49af-b9a5-e99b3782c845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b574b1a5724c421b9279805b1e9af9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:47Z,use_quota=True,user_id='ba8dc58cc12e4a36b14985fe9bce8638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089ae938-8eb0-4ec2-84ae-95480c92357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089ae938-8eb0-4ec2-84ae-95480c92357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf233aa-4604-472b-a9ea-f377d43695aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf233aa-4604-472b-a9ea-f377d43695aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d75e1b3-860d-49af-b9a5-e99b3782c845', 'volume_name': 'volume-6d75e1b3-860d-49af-b9a5-e99b3782c845', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007452ef-e580-4d8c-bdfb-6ca31b5e4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007452ef-e580-4d8c-bdfb-6ca31b5e4155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf9aa97-06a2-4ae5-81c8-788d0b26f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Volume 6d75e1b3-860d-49af-b9a5-e99b3782c845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d75e1b3-860d-49af-b9a5-e99b3782c845', 'volume_size': 1} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-844597995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d75e1b3-860d-49af-b9a5-e99b3782c845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b574b1a5724c421b9279805b1e9af9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:47Z,use_quota=True,user_id='ba8dc58cc12e4a36b14985fe9bce8638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Creating volume 6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:47 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:47 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 1073741824 Apr 21 20:59:47 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (778367e7-42dd-4799-b5c8-9ed7ec767902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44712f-c192-4365-8647-386d5631797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a44712f-c192-4365-8647-386d5631797c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2019390024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c31ba1-c941-4a92-9360-0d3fa6d33983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:47Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739a162e-31bf-41c9-92c8-112349b649f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739a162e-31bf-41c9-92c8-112349b649f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce027e5f-879b-4208-b9ca-bee1f0ac9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce027e5f-879b-4208-b9ca-bee1f0ac9e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c31ba1-c941-4a92-9360-0d3fa6d33983', 'volume_name': 'volume-54c31ba1-c941-4a92-9360-0d3fa6d33983', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c56537-faa4-4806-9c4d-7dd2bc77282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c56537-faa4-4806-9c4d-7dd2bc77282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04ec231-879b-4c42-a50a-e50472dd313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume 54c31ba1-c941-4a92-9360-0d3fa6d33983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c31ba1-c941-4a92-9360-0d3fa6d33983', 'volume_size': 1} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (f5a8f7d4-6b09-440d-a805-99d06110c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45af84ad-54e3-49f7-9dd3-6b9b6a363a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45af84ad-54e3-49f7-9dd3-6b9b6a363a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050625119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ff0944-33e4-4b45-943c-a267d7874d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:47Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82df4166-8860-44a0-bdf8-b277bfb04e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82df4166-8860-44a0-bdf8-b277bfb04e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad17396-0855-4d90-8aed-56949ab8f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad17396-0855-4d90-8aed-56949ab8f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ff0944-33e4-4b45-943c-a267d7874d08', 'volume_name': 'volume-e9ff0944-33e4-4b45-943c-a267d7874d08', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7f9185-b1df-40e1-9c32-3716bd8bc377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7f9185-b1df-40e1-9c32-3716bd8bc377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df850a4-b361-4440-841d-a80c8c70d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Volume e9ff0944-33e4-4b45-943c-a267d7874d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ff0944-33e4-4b45-943c-a267d7874d08', 'volume_size': 1} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (f35e7e20-a6db-48d1-badf-b03646931674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d107fa15-0b79-4fd8-a647-99e78ceb1f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d107fa15-0b79-4fd8-a647-99e78ceb1f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1231344426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66fb6f3-1a67-428d-a1d9-0e25b368ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c0f116-79da-4f87-977d-e0285577ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c0f116-79da-4f87-977d-e0285577ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e040876-40be-40cf-8146-8de20dffacf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e040876-40be-40cf-8146-8de20dffacf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66fb6f3-1a67-428d-a1d9-0e25b368ef01', 'volume_name': 'volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7246be-c729-4941-9a53-42222aaa4b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7246be-c729-4941-9a53-42222aaa4b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece04514-1987-479b-8e03-a66713202d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Volume d66fb6f3-1a67-428d-a1d9-0e25b368ef01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01', 'volume_size': 1} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (db4d4c4d-9e6b-429d-8ecc-f2f8d7a95cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a683c065-a679-403c-9647-40e24f8bb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a683c065-a679-403c-9647-40e24f8bb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1477734166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eea84cf-1fa6-4411-8d4e-7e7b7cbd244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eea84cf-1fa6-4411-8d4e-7e7b7cbd244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21217dc2-40cd-4a1b-80a0-ff71aa726915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21217dc2-40cd-4a1b-80a0-ff71aa726915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c', 'volume_name': 'volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1ebcb-05e7-43dc-a377-e20afbf73ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1ebcb-05e7-43dc-a377-e20afbf73ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2c8913-33ba-484a-9397-445183a17e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:47 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Volume 2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c', 'volume_size': 1} Apr 21 20:59:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:48 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 1073741824" returned: 0 in 0.726s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 20:59:48 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (159af3af-340b-4008-b0cd-2b1691555799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadfc41c-9732-4f98-b40b-49134bcf7054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadfc41c-9732-4f98-b40b-49134bcf7054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974298712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4942618-856a-43d3-b2c5-f827225930bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abde7fe-dd5a-4aa9-aaba-a4ca5fd083be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abde7fe-dd5a-4aa9-aaba-a4ca5fd083be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4676ad01-49d4-4274-8433-05790aaac724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4676ad01-49d4-4274-8433-05790aaac724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4942618-856a-43d3-b2c5-f827225930bb', 'volume_name': 'volume-e4942618-856a-43d3-b2c5-f827225930bb', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9307d3-24fd-409f-ae84-67c28072fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9307d3-24fd-409f-ae84-67c28072fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4f293-cf70-4815-bc96-08c558544aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Volume e4942618-856a-43d3-b2c5-f827225930bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4942618-856a-43d3-b2c5-f827225930bb', 'volume_size': 1} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (70344862-f85f-41ba-9656-9c0672415f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1525b132-8832-4a43-a775-1869d3e99121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1525b132-8832-4a43-a775-1869d3e99121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575089645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8523be4-c9c7-4c23-b7aa-22e929d2131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc54bdb-74f2-4788-a201-40acf9aa38cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc54bdb-74f2-4788-a201-40acf9aa38cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0e35ed-41bb-48de-b5a4-7b1ee23799b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0e35ed-41bb-48de-b5a4-7b1ee23799b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8523be4-c9c7-4c23-b7aa-22e929d2131f', 'volume_name': 'volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e560eaee-01f7-4c78-813a-c9cbb59736fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e560eaee-01f7-4c78-813a-c9cbb59736fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462990e4-0332-42a0-9653-c5017ed661f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Volume a8523be4-c9c7-4c23-b7aa-22e929d2131f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f', 'volume_size': 1} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:48 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.526s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.162s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2019390024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c31ba1-c941-4a92-9360-0d3fa6d33983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:47Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Creating volume 54c31ba1-c941-4a92-9360-0d3fa6d33983 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:48 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf9aa97-06a2-4ae5-81c8-788d0b26f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d75e1b3-860d-49af-b9a5-e99b3782c845', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 1073741824 Apr 21 20:59:48 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a82a73d-7d0a-4546-be41-844514cfe3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:48 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Volume volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 (6d75e1b3-860d-49af-b9a5-e99b3782c845): created successfully Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a82a73d-7d0a-4546-be41-844514cfe3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:48 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (759c87d5-fc31-4760-b649-a2291bcbf06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:48 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-cf013abf-e93e-4b40-94cd-510ff4ed9ed4 tempest-VolumeDependencyTests-385038631 None] Created volume successfully. Apr 21 20:59:49 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 1073741824" returned: 0 in 0.551s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 Apr 21 20:59:49 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:49 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983" returned: 0 in 0.505s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.118s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050625119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ff0944-33e4-4b45-943c-a267d7874d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:47Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Creating volume e9ff0944-33e4-4b45-943c-a267d7874d08 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:49 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04ec231-879b-4c42-a50a-e50472dd313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c31ba1-c941-4a92-9360-0d3fa6d33983', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 1073741824 Apr 21 20:59:49 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f218f8-a42f-45c9-9341-921e32c98335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:49 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 (54c31ba1-c941-4a92-9360-0d3fa6d33983): created successfully Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f218f8-a42f-45c9-9341-921e32c98335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:49 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (778367e7-42dd-4799-b5c8-9ed7ec767902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:49 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ddfb53f5-662a-428f-b5fe-b8e5ee093b8a tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created volume successfully. Apr 21 20:59:50 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 1073741824" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 Apr 21 20:59:50 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08" returned: 0 in 0.579s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.015s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1231344426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66fb6f3-1a67-428d-a1d9-0e25b368ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Creating volume d66fb6f3-1a67-428d-a1d9-0e25b368ef01 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:50 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:50 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 1073741824 Apr 21 20:59:50 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (793b36da-a502-4113-97ce-c5c3218f902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea1a85-aa72-4480-bd69-2532b642b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2df850a4-b361-4440-841d-a80c8c70d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ff0944-33e4-4b45-943c-a267d7874d08', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e284e-5e1e-45d0-bee4-51d213f97bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Volume volume-e9ff0944-33e4-4b45-943c-a267d7874d08 (e9ff0944-33e4-4b45-943c-a267d7874d08): created successfully Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372e284e-5e1e-45d0-bee4-51d213f97bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (f5a8f7d4-6b09-440d-a805-99d06110c699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea1a85-aa72-4480-bd69-2532b642b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457763804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c0a695-082e-4c77-bac1-8efe3ce6aafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19b7e93-0739-4945-a3e3-908a0fd4d6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19b7e93-0739-4945-a3e3-908a0fd4d6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14e97d-d220-4e39-a729-fe317dffe75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d14e97d-d220-4e39-a729-fe317dffe75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c0a695-082e-4c77-bac1-8efe3ce6aafd', 'volume_name': 'volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ffe244-4227-4359-81f9-0de981e292c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ffe244-4227-4359-81f9-0de981e292c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6f0e06-f7d6-4d5f-9223-9390918fa8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:50 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume e5c0a695-082e-4c77-bac1-8efe3ce6aafd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd', 'volume_size': 1} Apr 21 20:59:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ac0792bc-5571-4e11-bed6-412a60f4776f tempest-CreateVolumesFromImageTest-2031149021 None] Created volume successfully. Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (b3ee4169-3a83-47e7-904e-1b107912f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6528266a-83b8-49ad-a233-b8f0e8189c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6528266a-83b8-49ad-a233-b8f0e8189c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834171409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc22f668-72ea-4217-916f-c2227df3c330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd1256d-9a80-4057-a23f-b571ead415af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd1256d-9a80-4057-a23f-b571ead415af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c148c883-9b98-4139-ae79-46599ec284e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c148c883-9b98-4139-ae79-46599ec284e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc22f668-72ea-4217-916f-c2227df3c330', 'volume_name': 'volume-fc22f668-72ea-4217-916f-c2227df3c330', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a842a71-8d34-462a-a01b-1e2594741e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a842a71-8d34-462a-a01b-1e2594741e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5fb42b-350b-4f41-ab6b-8c3e9b779043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume fc22f668-72ea-4217-916f-c2227df3c330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc22f668-72ea-4217-916f-c2227df3c330', 'volume_size': 1} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (c18bafa0-ced1-4071-b1d3-f0884f3d4441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a76def-8a08-4176-96e8-dfb40f039953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48a76def-8a08-4176-96e8-dfb40f039953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-872019851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c98aad5-afa4-41a9-b191-9c5eee92c90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ae1f22-38bf-4008-9980-6332e7d54e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ae1f22-38bf-4008-9980-6332e7d54e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf94385-2572-4644-a020-3966c974d6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf94385-2572-4644-a020-3966c974d6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c98aad5-afa4-41a9-b191-9c5eee92c90d', 'volume_name': 'volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5300b5b1-dc94-4204-b4bc-c734ace89dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5300b5b1-dc94-4204-b4bc-c734ace89dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d1c3e5-6bd1-43d9-976d-c5f6ee83737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume 7c98aad5-afa4-41a9-b191-9c5eee92c90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d', 'volume_size': 1} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (a29fbf6d-bbcd-4f67-8404-b2ce43d6245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:51 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc45a61-e4ee-4471-854f-bd323d2f09c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 1073741824" returned: 0 in 0.731s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc45a61-e4ee-4471-854f-bd323d2f09c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441455016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa543010-0ac5-4c6e-b4dc-ef1406388311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20278e3-b01b-40c8-b2f7-4be776020da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20278e3-b01b-40c8-b2f7-4be776020da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cce874-95bc-427c-8144-fbf0dfbf59b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01cce874-95bc-427c-8144-fbf0dfbf59b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa543010-0ac5-4c6e-b4dc-ef1406388311', 'volume_name': 'volume-aa543010-0ac5-4c6e-b4dc-ef1406388311', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffb2097-9160-45d5-8101-6d9b8500542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dffb2097-9160-45d5-8101-6d9b8500542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4741524-bd66-4be2-881e-be8b830c728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume aa543010-0ac5-4c6e-b4dc-ef1406388311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa543010-0ac5-4c6e-b4dc-ef1406388311', 'volume_size': 1} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:51 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 Apr 21 20:59:51 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (84171b49-cec2-4a17-8c8e-1f4694988859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d1ce49-ffc1-4131-a7fb-b4f6d25f354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d1ce49-ffc1-4131-a7fb-b4f6d25f354f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1446615681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0724131f-0482-4a81-8ea2-9a783a3645d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:52Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769dfb90-745f-494b-85c7-3994a7eeebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769dfb90-745f-494b-85c7-3994a7eeebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e54b3f-5bf3-4f8f-88a1-82f3c18fd5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e54b3f-5bf3-4f8f-88a1-82f3c18fd5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0724131f-0482-4a81-8ea2-9a783a3645d6', 'volume_name': 'volume-0724131f-0482-4a81-8ea2-9a783a3645d6', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6060b41-4e7c-4857-928c-fb2e073b2ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6060b41-4e7c-4857-928c-fb2e073b2ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c932d33-d2f7-4ea8-ab75-90b98a2ff7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:51 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume 0724131f-0482-4a81-8ea2-9a783a3645d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0724131f-0482-4a81-8ea2-9a783a3645d6', 'volume_size': 1} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:52 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01" returned: 0 in 0.498s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.129s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1477734166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Creating volume 2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:52 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece04514-1987-479b-8e03-a66713202d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04606009-57e0-4eda-aabc-accb4b7be93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:52 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c 1073741824 Apr 21 20:59:52 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Volume volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 (d66fb6f3-1a67-428d-a1d9-0e25b368ef01): created successfully Apr 21 20:59:52 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04606009-57e0-4eda-aabc-accb4b7be93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (f35e7e20-a6db-48d1-badf-b03646931674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:52 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5417c28f-fe9b-4a0b-9cfd-87bb0ce9d12c tempest-CreateVolumesFromImageTest-2031149021 None] Created volume successfully. Apr 21 20:59:52 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:52 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c 1073741824" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:52 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c Apr 21 20:59:52 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c" returned: 0 in 0.493s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.916s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974298712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4942618-856a-43d3-b2c5-f827225930bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Creating volume e4942618-856a-43d3-b2c5-f827225930bb {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:53 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2c8913-33ba-484a-9397-445183a17e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682fff51-4bba-459f-9d64-aec84ede3436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:53 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb 1073741824 Apr 21 20:59:53 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:53 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Volume volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c (2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c): created successfully Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682fff51-4bba-459f-9d64-aec84ede3436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (db4d4c4d-9e6b-429d-8ecc-f2f8d7a95cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fd4419b5-48ba-4dca-b785-448d125013d9 tempest-CreateVolumesFromImageTest-2031149021 None] Created volume successfully. Apr 21 20:59:53 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb 1073741824" returned: 0 in 0.532s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:53 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb Apr 21 20:59:53 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:54 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb" returned: 0 in 0.495s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.787s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1575089645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8523be4-c9c7-4c23-b7aa-22e929d2131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d047179c4eb04011bcdfca4101a63ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:48Z,use_quota=True,user_id='b2574a135a4046afabd78e117fd889e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Creating volume a8523be4-c9c7-4c23-b7aa-22e929d2131f {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:54 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4f293-cf70-4815-bc96-08c558544aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4942618-856a-43d3-b2c5-f827225930bb', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:54 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f 1073741824 Apr 21 20:59:54 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6ad466-d465-4f76-901c-81253c538a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:54 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Volume volume-e4942618-856a-43d3-b2c5-f827225930bb (e4942618-856a-43d3-b2c5-f827225930bb): created successfully Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6ad466-d465-4f76-901c-81253c538a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (159af3af-340b-4008-b0cd-2b1691555799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:54 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5e36d9ca-b8cc-4b43-b87b-0f4bcf3afef9 tempest-CreateVolumesFromImageTest-2031149021 None] Created volume successfully. Apr 21 20:59:54 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f 1073741824" returned: 0 in 0.587s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:54 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:54 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f Apr 21 20:59:54 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:55 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f" returned: 0 in 0.471s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.810s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462990e4-0332-42a0-9653-c5017ed661f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6824eb-0b96-4c5f-8e93-36d7ed5add77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Creating offline snapshot f446fcca-b9e2-4391-af27-a157fbc85d7f of volume 6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 20:59:55 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Volume volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f (a8523be4-c9c7-4c23-b7aa-22e929d2131f): created successfully Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6824eb-0b96-4c5f-8e93-36d7ed5add77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Flow 'volume_create_manager' (70344862-f85f-41ba-9656-9c0672415f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc2c45-292a-4a72-953e-1461f9b5f982]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:55 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5a8c1e10-a77c-42fa-b567-a970ba6584e2 tempest-CreateVolumesFromImageTest-2031149021 None] Created volume successfully. Apr 21 20:59:55 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 20:59:55 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:55 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.540s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:55 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:55 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f 1G Apr 21 20:59:55 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-a8523be4-c9c7-4c23-b7aa-22e929d2131f-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-a8523be4-c9c7-4c23-b7aa-22e929d2131f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=108,cinder:DELETE=13,cinder:SELECT=86,cinder:INSERT=19 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-quobyte-a8523be4-c9c7-4c23-b7aa-22e929d2131f" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-a8523be4-c9c7-4c23-b7aa-22e929d2131f" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5074b0-38fb-45e1-94c1-137d8c400f5d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f Apr 21 20:59:56 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f 1G" returned: 0 in 0.558s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f Apr 21 20:59:56 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:56 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f" returned: 0 in 0.563s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:56 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:56 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f Apr 21 20:59:56 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f" returned: 0 in 0.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f is being set with open permissions: ugo+rw Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f Apr 21 20:59:57 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-a8523be4-c9c7-4c23-b7aa-22e929d2131f" returned: 0 in 0.455s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-a8523be4-c9c7-4c23-b7aa-22e929d2131f" released by "delete_volume" :: held 1.058s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Created reservations ['c4ea4290-0c4b-4e7b-a1d6-bb6dd08f1051', 'bf408275-b66f-4a2b-9659-eb21036f7be7', '92c8c175-5c50-42b9-84c9-79f1948800c9', '5ffdbb33-5958-4eae-9238-273a9e3a8304'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:57 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f" returned: 0 in 0.466s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info Apr 21 20:59:57 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:57 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 20:59:57 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Deleted volume successfully. Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7d5bfb1d-0683-41bb-8d50-2b7f226696c1 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-a8523be4-c9c7-4c23-b7aa-22e929d2131f-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:57 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:57 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info is being set with open permissions: ugo+rw Apr 21 20:59:57 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:57 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info Apr 21 20:59:57 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-e4942618-856a-43d3-b2c5-f827225930bb-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-e4942618-856a-43d3-b2c5-f827225930bb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-quobyte-e4942618-856a-43d3-b2c5-f827225930bb" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-e4942618-856a-43d3-b2c5-f827225930bb" acquired by "delete_volume" :: waited 0.006s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77a20aa-0a99-42f7-b9ae-8834b1a3c173]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb Apr 21 20:59:58 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.info" returned: 0 in 0.456s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.095s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.538s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-457763804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c0a695-082e-4c77-bac1-8efe3ce6aafd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Creating volume e5c0a695-082e-4c77-bac1-8efe3ce6aafd {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:58 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f78f6a79-7df6-4af7-956e-dea428b7a386 tempest-VolumeDependencyTests-385038631 None] Create snapshot completed successfully Apr 21 20:59:58 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd 1073741824 Apr 21 20:59:58 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:58 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb" returned: 0 in 0.608s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:58 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:58 devstack sudo[89725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb Apr 21 20:59:58 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd 1073741824" returned: 0 in 0.724s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 20:59:59 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (53035564-525c-4690-b7f7-3da5ef2ffebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee2af6a-38f7-4583-b62a-563225c28a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ee2af6a-38f7-4583-b62a-563225c28a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1920833946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c0fef05-e2bb-41ce-89d9-5314aafbdeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b574b1a5724c421b9279805b1e9af9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f446fcca-b9e2-4391-af27-a157fbc85d7f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:59Z,use_quota=True,user_id='ba8dc58cc12e4a36b14985fe9bce8638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0aa5a6-f701-4874-8fe6-2923664a896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0aa5a6-f701-4874-8fe6-2923664a896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1503e1-707f-40d9-a280-ca8758ed4d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1503e1-707f-40d9-a280-ca8758ed4d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8c0fef05-e2bb-41ce-89d9-5314aafbdeb6', 'volume_name': 'volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6', 'volume_size': 1, 'snapshot_id': 'f446fcca-b9e2-4391-af27-a157fbc85d7f'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46237591-99f7-43ac-9af2-73a2e3b6531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46237591-99f7-43ac-9af2-73a2e3b6531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5145fe95-609a-4101-8644-ebcecc2781e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Volume 8c0fef05-e2bb-41ce-89d9-5314aafbdeb6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6', 'volume_size': 1, 'snapshot_id': 'f446fcca-b9e2-4391-af27-a157fbc85d7f'} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:59 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e4942618-856a-43d3-b2c5-f827225930bb" returned: 0 in 0.589s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-e4942618-856a-43d3-b2c5-f827225930bb" released by "delete_volume" :: held 1.231s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Created reservations ['94157b8b-5ddb-4db2-b7d4-e54fa90f864c', 'c021766b-ecbc-49ce-a7b0-fafb256b0eeb', '6e2896fe-7b63-458b-b395-a38aa6223e58', 'fd75856e-72cd-4bbc-a099-bece035684a2'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 20:59:59 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd" returned: 0 in 0.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.496s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834171409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc22f668-72ea-4217-916f-c2227df3c330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Creating volume fc22f668-72ea-4217-916f-c2227df3c330 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 20:59:59 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6f0e06-f7d6-4d5f-9223-9390918fa8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2dbfb9-68fd-47db-9c12-03f6e8e08935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 20:59:59 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 1073741824 Apr 21 20:59:59 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 20:59:59 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd (e5c0a695-082e-4c77-bac1-8efe3ce6aafd): created successfully Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2dbfb9-68fd-47db-9c12-03f6e8e08935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 20:59:59 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (793b36da-a502-4113-97ce-c5c3218f902e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 20:59:59 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-edde54ca-2bd0-4924-bcf2-488bd4763240 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created volume successfully. Apr 21 21:00:00 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.545s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:00 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Deleted volume successfully. Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8074dac8-11a1-456f-b7df-1607048cd78a tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-e4942618-856a-43d3-b2c5-f827225930bb-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-quobyte-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3805801f-ba71-4c0a-9655-3446176b4ec5]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 1073741824" returned: 0 in 0.830s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:00 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c Apr 21 21:00:00 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:00 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:00 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 Apr 21 21:00:00 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:01 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c" returned: 0 in 0.661s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:01 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c Apr 21 21:00:01 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:01 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330" returned: 0 in 0.624s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.816s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-872019851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c98aad5-afa4-41a9-b191-9c5eee92c90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Creating volume 7c98aad5-afa4-41a9-b191-9c5eee92c90d {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:01 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:01 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d 1073741824 Apr 21 21:00:01 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5fb42b-350b-4f41-ab6b-8c3e9b779043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc22f668-72ea-4217-916f-c2227df3c330', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4012383a-9f0e-4289-83d1-fd0f1f68319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:01 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume volume-fc22f668-72ea-4217-916f-c2227df3c330 (fc22f668-72ea-4217-916f-c2227df3c330): created successfully Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4012383a-9f0e-4289-83d1-fd0f1f68319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (b3ee4169-3a83-47e7-904e-1b107912f11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:01 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-c305ed07-e97e-44d0-84a2-f0b40bef4876 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created volume successfully. Apr 21 21:00:01 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c" returned: 0 in 0.501s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c" released by "delete_volume" :: held 1.184s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Created reservations ['3994b784-5ca5-4f83-81d7-73d4258336f5', '2c72069b-ef4c-457b-8a4a-e988d1dedbfd', 'd4771462-24ab-47fb-8edd-173b05a6b5fd', 'fdaa9777-4525-48dc-be4b-e2c0e6b48c68'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:01 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:01 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:01 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d 1073741824" returned: 0 in 0.685s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:01 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d Apr 21 21:00:02 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.556s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:02 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Deleted volume successfully. Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-276635ee-723b-47b1-ae1d-082334303652 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-2b4f9ac9-d7c5-4224-8c4e-9180e3ec211c-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:02 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d" returned: 0 in 0.518s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.910s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-441455016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa543010-0ac5-4c6e-b4dc-ef1406388311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:51Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Creating volume aa543010-0ac5-4c6e-b4dc-ef1406388311 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:02 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d1c3e5-6bd1-43d9-976d-c5f6ee83737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca49718-2c99-48dc-a045-3b3c23e52b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:02 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 1073741824 Apr 21 21:00:02 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:02 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d (7c98aad5-afa4-41a9-b191-9c5eee92c90d): created successfully Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca49718-2c99-48dc-a045-3b3c23e52b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (c18bafa0-ced1-4071-b1d3-f0884f3d4441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:02 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3e2d8a39-c4e0-44bd-b360-1ed8ce24bd94 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created volume successfully. Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-d66fb6f3-1a67-428d-a1d9-0e25b368ef01-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-d66fb6f3-1a67-428d-a1d9-0e25b368ef01-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-quobyte-d66fb6f3-1a67-428d-a1d9-0e25b368ef01" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-d66fb6f3-1a67-428d-a1d9-0e25b368ef01" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a59fb-d106-4e3e-b191-6163ab1d8aa0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:02 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:02 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 Apr 21 21:00:02 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 1073741824" returned: 0 in 0.549s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 Apr 21 21:00:03 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01" returned: 0 in 0.525s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01 Apr 21 21:00:03 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Flow 'volume_create_manager' (ac3bda37-7a1e-4997-bda7-2c2ab0eef612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c4a570-be3d-49b1-91ef-64a0252209a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c4a570-be3d-49b1-91ef-64a0252209a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-115065111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca27273-cebf-4448-99bf-6d0025e2380e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc61a651a0654b9c98b890361a2763e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:03Z,use_quota=True,user_id='ca9835ad856e43f5ba8fc7faf16e435c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c330a9e9-d72a-4286-8bb4-188c88d6be02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c330a9e9-d72a-4286-8bb4-188c88d6be02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5b77d8-454f-43fa-8b97-060832443782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5b77d8-454f-43fa-8b97-060832443782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca27273-cebf-4448-99bf-6d0025e2380e', 'volume_name': 'volume-eca27273-cebf-4448-99bf-6d0025e2380e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e0460a-410d-4327-9b43-1d58204b11a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e0460a-410d-4327-9b43-1d58204b11a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90866a24-a11f-4139-8fd0-11dc28239ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Volume eca27273-cebf-4448-99bf-6d0025e2380e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca27273-cebf-4448-99bf-6d0025e2380e', 'volume_size': 1} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:03 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311" returned: 0 in 0.546s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.828s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T18:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1446615681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0724131f-0482-4a81-8ea2-9a783a3645d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34313cb24c044623be4ea15d5bb9948d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T18:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T18:59:52Z,use_quota=True,user_id='fd0b0dde0bf5464fb2b69ae8c15c65a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Creating volume 0724131f-0482-4a81-8ea2-9a783a3645d6 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:03 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4741524-bd66-4be2-881e-be8b830c728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa543010-0ac5-4c6e-b4dc-ef1406388311', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 1073741824 Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ee9722-4f03-4c85-8332-5f06af79d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:03 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:03 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 (aa543010-0ac5-4c6e-b4dc-ef1406388311): created successfully Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ee9722-4f03-4c85-8332-5f06af79d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (a29fbf6d-bbcd-4f67-8404-b2ce43d6245a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:03 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6ce0d985-505c-4150-b986-e763c745bbbb tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created volume successfully. Apr 21 21:00:03 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-d66fb6f3-1a67-428d-a1d9-0e25b368ef01" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-d66fb6f3-1a67-428d-a1d9-0e25b368ef01" released by "delete_volume" :: held 0.975s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Created reservations ['b3bc3807-e919-487a-81ca-43f84fd539cc', '46121ca1-5b5b-4134-9c3e-2d956f2a985f', '824b27fc-5b8e-4f4c-b694-acff75325ff3', 'bfe1db14-46c0-4396-a670-3f3a4d352814'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:03 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:03 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:03 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.402s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Deleted volume successfully. Apr 21 21:00:04 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-4a5abd4c-7def-41be-85c0-f3db0f0e7b32 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-d66fb6f3-1a67-428d-a1d9-0e25b368ef01-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 1073741824" returned: 0 in 0.566s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 Apr 21 21:00:04 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6" returned: 0 in 0.474s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.320s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-f446fcca-b9e2-4391-af27-a157fbc85d7f-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c932d33-d2f7-4ea8-ab75-90b98a2ff7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0724131f-0482-4a81-8ea2-9a783a3645d6', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1360230d-b7cb-470f-8477-bc3fe81da212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-f446fcca-b9e2-4391-af27-a157fbc85d7f-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Creating volume 8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 from snapshot f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Volume volume-0724131f-0482-4a81-8ea2-9a783a3645d6 (0724131f-0482-4a81-8ea2-9a783a3645d6): created successfully Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1360230d-b7cb-470f-8477-bc3fe81da212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Flow 'volume_create_manager' (84171b49-cec2-4a17-8c8e-1f4694988859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] snapshot: f446fcca-b9e2-4391-af27-a157fbc85d7f, volume: 8c0fef05-e2bb-41ce-89d9-5314aafbdeb6, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:00:04 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-40139d68-cfd3-4bb2-96da-95768a7962f8 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created volume successfully. Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d028d3db-2202-4290-ac6f-f69bf92881bb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-e9ff0944-33e4-4b45-943c-a267d7874d08-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-e9ff0944-33e4-4b45-943c-a267d7874d08-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f Apr 21 21:00:04 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "cinder-quobyte-e9ff0944-33e4-4b45-943c-a267d7874d08" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-e9ff0944-33e4-4b45-943c-a267d7874d08" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de8e7f-4dbe-4c31-9673-a9fb2901ecfe]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:04 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:04 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 Apr 21 21:00:04 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f" returned: 0 in 0.524s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d75e1b3-860d-49af-b9a5-e99b3782c845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd1b6ba-e259-4497-8f43-d01da2963c88]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08" returned: 0 in 0.490s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 21:00:05 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08 Apr 21 21:00:05 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-0724131f-0482-4a81-8ea2-9a783a3645d6-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-0724131f-0482-4a81-8ea2-9a783a3645d6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-quobyte-0724131f-0482-4a81-8ea2-9a783a3645d6" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-0724131f-0482-4a81-8ea2-9a783a3645d6" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bf5ef7-0b02-4815-9d8b-2e58cffa4ad3]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 Apr 21 21:00:05 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e9ff0944-33e4-4b45-943c-a267d7874d08" returned: 0 in 0.467s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-quobyte-e9ff0944-33e4-4b45-943c-a267d7874d08" released by "delete_volume" :: held 0.980s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:05 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.549s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 Apr 21 21:00:05 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Created reservations ['ea0d06c8-03a9-457c-b16f-919f86c71d75', '43f5c9e5-a835-4d26-aa5d-4af26006e8da', '7eee0048-a095-47c1-ae20-937df1ef6d2b', 'b1a121d6-66ca-4ac2-875d-810f43352014'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:05 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:05 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:05 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6" returned: 0 in 0.504s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:06 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6 Apr 21 21:00:06 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:06 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:06 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.601s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:06 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:06 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Deleted volume successfully. Apr 21 21:00:06 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d8315dca-db0b-48dd-8f12-d5f551d34e70 tempest-CreateVolumesFromImageTest-2031149021 None] Lock "cinder-e9ff0944-33e4-4b45-943c-a267d7874d08-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:07 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-0724131f-0482-4a81-8ea2-9a783a3645d6" returned: 0 in 1.348s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-0724131f-0482-4a81-8ea2-9a783a3645d6" released by "delete_volume" :: held 1.888s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created reservations ['1b085d35-3527-4582-ba0f-0d7e5bc85905', '10339461-532c-441c-bb7e-a2ce04d427d2', '6d550271-28d2-472b-8ac8-a44cf14f8a38', 'b95c1dd1-9e70-4d3e-b4f2-94644185ed19'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:07 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:07 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:07 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-aa543010-0ac5-4c6e-b4dc-ef1406388311-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-aa543010-0ac5-4c6e-b4dc-ef1406388311-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-quobyte-aa543010-0ac5-4c6e-b4dc-ef1406388311" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-aa543010-0ac5-4c6e-b4dc-ef1406388311" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dafa8a9-80fc-40b6-9ae9-194d74b3ec7e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" returned: 0 in 2.352s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475ae73-406a-4c52-9658-3972e00c9c75]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 Apr 21 21:00:08 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 21:00:08 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.594s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:08 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Deleted volume successfully. Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0276c9fc-e582-456c-b84c-cf99d8856f6c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-0724131f-0482-4a81-8ea2-9a783a3645d6-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:08 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311" returned: 0 in 0.603s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:08 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311 Apr 21 21:00:08 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:08 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.762s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:08 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Converted 1024.00 MB image at 435.14 MB/s Apr 21 21:00:08 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 is being set with open permissions: ugo+rw Apr 21 21:00:08 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:09 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 Apr 21 21:00:09 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:09 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-aa543010-0ac5-4c6e-b4dc-ef1406388311" returned: 0 in 0.464s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-aa543010-0ac5-4c6e-b4dc-ef1406388311" released by "delete_volume" :: held 1.090s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created reservations ['f6bbf2a1-a9fc-47cd-9aee-2db602250959', '68a1d260-2742-4fbf-b9a8-0c5c8207bfe3', 'a0efe63c-d966-4019-847a-eba6be9ffef7', 'bfb3768d-838b-4be8-9863-de5a07c9f410'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:09 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:09 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:09 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" returned: 0 in 0.502s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" released by "_copy_volume_from_snapshot" :: held 4.760s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-f446fcca-b9e2-4391-af27-a157fbc85d7f-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" released by "_create_volume_from_snapshot" :: held 4.791s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.816s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.171s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-115065111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca27273-cebf-4448-99bf-6d0025e2380e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc61a651a0654b9c98b890361a2763e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:03Z,use_quota=True,user_id='ca9835ad856e43f5ba8fc7faf16e435c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Creating volume eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:09 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:09 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e 1073741824 Apr 21 21:00:09 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5145fe95-609a-4101-8644-ebcecc2781e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6', 'volume_size': 1, 'snapshot_id': 'f446fcca-b9e2-4391-af27-a157fbc85d7f'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b961b7-132e-4d72-8965-e91fadcb4072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (ed95ceac-573a-4c17-b295-ee56e9c568cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96acebb-bd32-459d-b13b-47ac26712024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96acebb-bd32-459d-b13b-47ac26712024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-10970473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219ac45c-e589-43ce-8b7b-6e75db6216b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:09Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc28b000-0284-4d72-9482-e9bb548d9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc28b000-0284-4d72-9482-e9bb548d9563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faba6b80-b82c-4e72-bda1-b90e90594714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faba6b80-b82c-4e72-bda1-b90e90594714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219ac45c-e589-43ce-8b7b-6e75db6216b1', 'volume_name': 'volume-219ac45c-e589-43ce-8b7b-6e75db6216b1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f7703c-792b-4228-b667-fe8b984667e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f7703c-792b-4228-b667-fe8b984667e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2cebd1-88b7-49f5-bc40-177b9723cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:09 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume 219ac45c-e589-43ce-8b7b-6e75db6216b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219ac45c-e589-43ce-8b7b-6e75db6216b1', 'volume_size': 1} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:09 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Volume volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 (8c0fef05-e2bb-41ce-89d9-5314aafbdeb6): created successfully Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b961b7-132e-4d72-8965-e91fadcb4072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (53035564-525c-4690-b7f7-3da5ef2ffebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ebabc9a2-f3b3-4f23-9d70-9678714acf5e tempest-VolumeDependencyTests-385038631 None] Created volume successfully. Apr 21 21:00:09 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.463s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:09 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Deleted volume successfully. Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-54d8dcc9-8318-4c2d-9d94-53d495ed240c tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-aa543010-0ac5-4c6e-b4dc-ef1406388311-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-f446fcca-b9e2-4391-af27-a157fbc85d7f-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-f446fcca-b9e2-4391-af27-a157fbc85d7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-6d75e1b3-860d-49af-b9a5-e99b3782c845" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-6d75e1b3-860d-49af-b9a5-e99b3782c845" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-f446fcca-b9e2-4391-af27-a157fbc85d7f" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-f446fcca-b9e2-4391-af27-a157fbc85d7f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Deleting offline snapshot f446fcca-b9e2-4391-af27-a157fbc85d7f of volume 6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] snapshot_file for this snap is: volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94c2e74-576d-4016-ae70-bbca4f1fb73d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:09 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f Apr 21 21:00:10 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e 1073741824" returned: 0 in 0.555s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:10 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-7c98aad5-afa4-41a9-b191-9c5eee92c90d-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-7c98aad5-afa4-41a9-b191-9c5eee92c90d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-quobyte-7c98aad5-afa4-41a9-b191-9c5eee92c90d" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-7c98aad5-afa4-41a9-b191-9c5eee92c90d" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d40276a-e3ff-4674-9bb8-b9338ae96953]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d Apr 21 21:00:10 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f" returned: 0 in 0.455s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d75e1b3-860d-49af-b9a5-e99b3782c845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1812a-2c04-429c-af81-57ce4088903f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 21:00:10 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.482s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-10970473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219ac45c-e589-43ce-8b7b-6e75db6216b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:09Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating volume 219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:10 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 1073741824 Apr 21 21:00:10 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90866a24-a11f-4139-8fd0-11dc28239ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca27273-cebf-4448-99bf-6d0025e2380e', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3032eb94-6f6d-47d8-8232-be2b449ae092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:10 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Volume volume-eca27273-cebf-4448-99bf-6d0025e2380e (eca27273-cebf-4448-99bf-6d0025e2380e): created successfully Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3032eb94-6f6d-47d8-8232-be2b449ae092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Flow 'volume_create_manager' (ac3bda37-7a1e-4997-bda7-2c2ab0eef612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:10 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-568773fa-df2c-4e47-8a23-2817c3c0477a tempest-SnapshotDependencyTests-90289795 None] Created volume successfully. Apr 21 21:00:10 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d" returned: 0 in 0.577s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d Apr 21 21:00:10 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:10 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:10 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:10 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f Apr 21 21:00:10 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 1073741824" returned: 0 in 0.518s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 Apr 21 21:00:11 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-7c98aad5-afa4-41a9-b191-9c5eee92c90d" returned: 0 in 0.423s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-7c98aad5-afa4-41a9-b191-9c5eee92c90d" released by "delete_volume" :: held 1.025s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created reservations ['052b7a38-3b15-48dc-a49c-8086390e8f47', 'db889a41-3266-4d85-9ced-8780cc3371e9', 'b5f7d5e6-9b89-4383-b56d-1ba0ddcb3a21', '090f82c3-6aa8-4615-8e22-45b620ac8aeb'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:11 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f" returned: 0 in 0.588s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f Apr 21 21:00:11 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.611s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Creating offline snapshot 8e547a41-538a-4f52-91fe-1a972fe64f9f of volume eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2cebd1-88b7-49f5-bc40-177b9723cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219ac45c-e589-43ce-8b7b-6e75db6216b1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc28ce58-8b58-4037-a6e9-69f83e9daa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4c4c7a-e39d-4476-bca9-106ef3ffd941]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:11 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 (219ac45c-e589-43ce-8b7b-6e75db6216b1): created successfully Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc28ce58-8b58-4037-a6e9-69f83e9daa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (ed95ceac-573a-4c17-b295-ee56e9c568cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-ea49abd4-a453-49be-a5ce-77eebef6118d tempest-CreateVolumesFromSnapshotTest-321100310 None] Created volume successfully. Apr 21 21:00:11 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:11 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:11 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:11 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Deleted volume successfully. Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-fea30a20-c529-48eb-abc7-e866229ce8f9 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-7c98aad5-afa4-41a9-b191-9c5eee92c90d-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:11 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845.f446fcca-b9e2-4391-af27-a157fbc85d7f" returned: 0 in 0.431s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-f446fcca-b9e2-4391-af27-a157fbc85d7f" released by "_delete_snapshot" :: held 2.013s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-6d75e1b3-860d-49af-b9a5-e99b3782c845" released by "delete_snapshot" :: held 2.028s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:11 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Created reservations ['a9d71ed1-9fd6-4e34-b18f-3cf524c0dec0', 'ca847789-c20b-4b1e-ae1a-b6bec40ccc8d', '3419f332-51ab-47ab-af69-16711836c1e1', 'dd1a273e-513c-4fd6-9349-ec18d0489f6f'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:12 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Delete snapshot completed successfully. Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8550aedf-e099-4720-8bd7-6c8673aac587 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-f446fcca-b9e2-4391-af27-a157fbc85d7f-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:12 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.508s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:12 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f 1G Apr 21 21:00:12 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-fc22f668-72ea-4217-916f-c2227df3c330-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-fc22f668-72ea-4217-916f-c2227df3c330-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-quobyte-fc22f668-72ea-4217-916f-c2227df3c330" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-fc22f668-72ea-4217-916f-c2227df3c330" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca59ce-61f6-40b7-a984-8d94466af25d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:12 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 Apr 21 21:00:12 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f 1G" returned: 0 in 0.480s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca27273-cebf-4448-99bf-6d0025e2380e -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:12 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca27273-cebf-4448-99bf-6d0025e2380e -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f Apr 21 21:00:12 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:12 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:13 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330" returned: 0 in 0.564s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-6d75e1b3-860d-49af-b9a5-e99b3782c845-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:13 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330 Apr 21 21:00:13 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca27273-cebf-4448-99bf-6d0025e2380e -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f is being set with open permissions: ugo+rw Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-6d75e1b3-860d-49af-b9a5-e99b3782c845-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:13 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f Apr 21 21:00:13 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-6d75e1b3-860d-49af-b9a5-e99b3782c845" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-6d75e1b3-860d-49af-b9a5-e99b3782c845" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6bbc25-8274-464e-8e41-4ced3b33509a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 21:00:13 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-fc22f668-72ea-4217-916f-c2227df3c330" returned: 0 in 0.419s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-fc22f668-72ea-4217-916f-c2227df3c330" released by "delete_volume" :: held 1.007s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:13 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f" returned: 0 in 0.407s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info Apr 21 21:00:13 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created reservations ['599d98b2-5116-44e6-97ea-1a1b3379f7c6', '97e7bdf2-9cce-4e61-8d1c-9faf44317b53', '54f0f3b5-5826-43b4-a2c2-0d44336053aa', '0c3952c5-578b-42bd-a221-890df1f1ea20'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:13 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.505s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845 Apr 21 21:00:13 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info" returned: 0 in 0.416s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:13 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info is being set with open permissions: ugo+rw Apr 21 21:00:13 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:13 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info Apr 21 21:00:13 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:13 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.423s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:14 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Deleted volume successfully. Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-5fd1a3d5-18b4-4461-8d3e-6a6afc4ba62d tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-fc22f668-72ea-4217-916f-c2227df3c330-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:14 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-6d75e1b3-860d-49af-b9a5-e99b3782c845" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-6d75e1b3-860d-49af-b9a5-e99b3782c845" released by "delete_volume" :: held 1.004s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Created reservations ['c2037cac-7022-48e4-9c35-96bdcf4ebd43', 'c9edf6d2-27d0-41cc-9fdc-da75fa03aaa8', 'b5350b77-06a5-4e23-8d51-0d38485afdb5', '045c7192-91ee-4502-99a8-f69bc8bb1fe3'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:14 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.info" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.594s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:14 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e5169321-0f06-4b5e-86ee-c14f4e276083 tempest-SnapshotDependencyTests-90289795 None] Create snapshot completed successfully Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating offline snapshot 773d1fb5-471a-4ca9-9907-d29761c985ac of volume 219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8321f01-cd00-404c-bed4-c79da8311fa6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 Apr 21 21:00:14 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-e5c0a695-082e-4c77-bac1-8efe3ce6aafd-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-e5c0a695-082e-4c77-bac1-8efe3ce6aafd-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-quobyte-e5c0a695-082e-4c77-bac1-8efe3ce6aafd" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-e5c0a695-082e-4c77-bac1-8efe3ce6aafd" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a38395-79bf-444b-a202-3d3485332629]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:14 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.432s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:14 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Deleted volume successfully. Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e8a4fe66-bb9b-4e32-9811-a8719cfd50f8 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-6d75e1b3-860d-49af-b9a5-e99b3782c845-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:14 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd Apr 21 21:00:14 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:14 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1" returned: 0 in 0.539s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:14 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac 1G Apr 21 21:00:15 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd" returned: 0 in 0.493s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd Apr 21 21:00:15 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Flow 'volume_create_manager' (dad60a76-ad3b-4b58-9362-69f698d814d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e834d4fd-268a-4035-835d-8ea54c5c1960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e834d4fd-268a-4035-835d-8ea54c5c1960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a90d02-fab8-4e3c-99c6-752596742be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc61a651a0654b9c98b890361a2763e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e547a41-538a-4f52-91fe-1a972fe64f9f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:15Z,use_quota=True,user_id='ca9835ad856e43f5ba8fc7faf16e435c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b0202f-4ab8-438b-8dac-12c8fa3ba651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b0202f-4ab8-438b-8dac-12c8fa3ba651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a45ce1-7ff0-4d27-b7ca-2f281823efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a45ce1-7ff0-4d27-b7ca-2f281823efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32a90d02-fab8-4e3c-99c6-752596742be8', 'volume_name': 'volume-32a90d02-fab8-4e3c-99c6-752596742be8', 'volume_size': 1, 'snapshot_id': '8e547a41-538a-4f52-91fe-1a972fe64f9f'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6506d9-b3ba-4488-960f-eb42b7455492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6506d9-b3ba-4488-960f-eb42b7455492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a985e4-2638-40ee-83cd-ac62a89713a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Volume 32a90d02-fab8-4e3c-99c6-752596742be8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32a90d02-fab8-4e3c-99c6-752596742be8', 'volume_size': 1, 'snapshot_id': '8e547a41-538a-4f52-91fe-1a972fe64f9f'} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:15 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac 1G" returned: 0 in 0.573s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:15 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac Apr 21 21:00:15 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (124b12e0-41b8-443e-aa50-bbaf8e77efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f078564-ae1a-4372-8a7f-83e6845400a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-e5c0a695-082e-4c77-bac1-8efe3ce6aafd" returned: 0 in 0.473s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f078564-ae1a-4372-8a7f-83e6845400a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-516391489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a9de71-4e22-4aa2-b195-7faeea0bb094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b574b1a5724c421b9279805b1e9af9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:16Z,use_quota=True,user_id='ba8dc58cc12e4a36b14985fe9bce8638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9b14fa-7648-4da1-85b3-76c586b07738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9b14fa-7648-4da1-85b3-76c586b07738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0ffd53-5068-4bc9-b58d-a500a490cce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0ffd53-5068-4bc9-b58d-a500a490cce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a9de71-4e22-4aa2-b195-7faeea0bb094', 'volume_name': 'volume-81a9de71-4e22-4aa2-b195-7faeea0bb094', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8637e13-2e89-4152-93b1-ca5fa7405893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8637e13-2e89-4152-93b1-ca5fa7405893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe54c7e-7a91-453f-ad04-6640f1a08dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:15 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Volume 81a9de71-4e22-4aa2-b195-7faeea0bb094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a9de71-4e22-4aa2-b195-7faeea0bb094', 'volume_size': 1} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-e5c0a695-082e-4c77-bac1-8efe3ce6aafd" released by "delete_volume" :: held 1.021s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created reservations ['870be89d-603a-400b-8b98-dc7e64626da9', 'db9d72f6-86d9-4478-84af-3d92f79924f3', '4a382c50-1279-47a9-96d8-d8a207a3f817', 'f3867634-8c1c-47be-bf74-ffcf0819242b'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:15 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:15 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:15 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac" returned: 0 in 0.444s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:15 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac is being set with open permissions: ugo+rw Apr 21 21:00:15 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac Apr 21 21:00:16 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:16 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.420s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:16 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Deleted volume successfully. Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1c27399c-dec3-4004-baa4-54a73b4c0593 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-e5c0a695-082e-4c77-bac1-8efe3ce6aafd-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:16 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac" returned: 0 in 0.394s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info Apr 21 21:00:16 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-54c31ba1-c941-4a92-9360-0d3fa6d33983-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-54c31ba1-c941-4a92-9360-0d3fa6d33983-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "cinder-quobyte-54c31ba1-c941-4a92-9360-0d3fa6d33983" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-54c31ba1-c941-4a92-9360-0d3fa6d33983" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0de71f8-ee0e-40e9-b1c8-be2702543f3a]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info" returned: 0 in 0.433s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:16 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info is being set with open permissions: ugo+rw Apr 21 21:00:16 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:16 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info Apr 21 21:00:16 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:16 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 Apr 21 21:00:16 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:17 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:17 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983 Apr 21 21:00:17 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:17 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.info" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.890s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.763s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-quobyte-8e547a41-538a-4f52-91fe-1a972fe64f9f-32a90d02-fab8-4e3c-99c6-752596742be8" by "_create_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-8e547a41-538a-4f52-91fe-1a972fe64f9f-32a90d02-fab8-4e3c-99c6-752596742be8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Creating volume 32a90d02-fab8-4e3c-99c6-752596742be8 from snapshot 8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-quobyte-32a90d02-fab8-4e3c-99c6-752596742be8" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-32a90d02-fab8-4e3c-99c6-752596742be8" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] snapshot: 8e547a41-538a-4f52-91fe-1a972fe64f9f, volume: 32a90d02-fab8-4e3c-99c6-752596742be8, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:17 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-52efa678-a573-4181-9bc2-1d0732d40b95 tempest-CreateVolumesFromSnapshotTest-321100310 None] Create snapshot completed successfully Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d926e6e5-7ddc-4256-822b-9ca880f5161c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:17 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f Apr 21 21:00:17 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:17 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-54c31ba1-c941-4a92-9360-0d3fa6d33983" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-quobyte-54c31ba1-c941-4a92-9360-0d3fa6d33983" released by "delete_volume" :: held 0.937s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Created reservations ['6a6c8dc3-dc24-4506-ae45-fae7f5a88027', 'f9cc71e3-a305-4a28-a652-113ac311a6bc', '0fe5945c-14c1-47e4-9691-11471d573b61', '389307bd-575c-4a97-8830-f70fa35c3677'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:17 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:17 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:17 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f" returned: 0 in 0.475s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eca27273-cebf-4448-99bf-6d0025e2380e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ed5e3-d739-473f-8d6a-0ab4d6181d67]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:17 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:17 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:17 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (afc78457-6d0d-47a1-97c2-1b873ce1e2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b24884-667b-444b-8579-e43f3a337f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b24884-667b-444b-8579-e43f3a337f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429999269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5c90a4-3b6f-4ce2-a631-42a0be476f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:18Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80a90bc-4b58-45d1-b8a5-d5e111a14d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80a90bc-4b58-45d1-b8a5-d5e111a14d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68e386a-e2bd-4e90-bccc-a37ca430fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68e386a-e2bd-4e90-bccc-a37ca430fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5c90a4-3b6f-4ce2-a631-42a0be476f44', 'volume_name': 'volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0e5f11-e194-49e1-9749-d8257bcbb70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0e5f11-e194-49e1-9749-d8257bcbb70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3164e21-95ea-40b8-9ea3-555aea8c268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume 4c5c90a4-3b6f-4ce2-a631-42a0be476f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44', 'volume_size': 1} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.563s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:18 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Deleted volume successfully. Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d152743d-1391-4dd3-83d6-6532a2334ca2 tempest-CreateVolumesFromSourceVolumeTest-885825384 None] Lock "cinder-54c31ba1-c941-4a92-9360-0d3fa6d33983-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:18 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (eccc62a7-7a37-4961-b9bc-56935882d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831e6013-0dfa-4df2-82dc-8a1a5444a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.726s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831e6013-0dfa-4df2-82dc-8a1a5444a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032921556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832f2afe-b597-407f-aa29-d4d1cc8858e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 Apr 21 21:00:18 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3149d49d-9c22-410b-abc7-73677c83e893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3149d49d-9c22-410b-abc7-73677c83e893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465a5678-804d-42cc-8553-fdabf2154991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465a5678-804d-42cc-8553-fdabf2154991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '832f2afe-b597-407f-aa29-d4d1cc8858e1', 'volume_name': 'volume-832f2afe-b597-407f-aa29-d4d1cc8858e1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c203f5f5-db7c-465f-ab24-f2342d9f2028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c203f5f5-db7c-465f-ab24-f2342d9f2028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968097fc-9732-4fd9-ad9f-a7e43ff8fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume 832f2afe-b597-407f-aa29-d4d1cc8858e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-832f2afe-b597-407f-aa29-d4d1cc8858e1', 'volume_size': 1} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (6cf7cf27-b580-42fe-8aa0-7fab6623a57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcfcf7b-c86f-49c0-b0e5-ae8462e8db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcfcf7b-c86f-49c0-b0e5-ae8462e8db65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76949718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909fa06e-df50-4af6-b746-40437909a185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41205f2e-3449-4156-829a-bbda7b065ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41205f2e-3449-4156-829a-bbda7b065ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1caf6ef6-9e1b-42c0-8b49-bc9b44d819d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1caf6ef6-9e1b-42c0-8b49-bc9b44d819d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909fa06e-df50-4af6-b746-40437909a185', 'volume_name': 'volume-909fa06e-df50-4af6-b746-40437909a185', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec61a26-a5e5-47b6-9584-b7e01dc3c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec61a26-a5e5-47b6-9584-b7e01dc3c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2548cc8-04e0-4946-9595-697515da71d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:18 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume 909fa06e-df50-4af6-b746-40437909a185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909fa06e-df50-4af6-b746-40437909a185', 'volume_size': 1} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:18 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (0255b031-9d8c-4ba7-9fcd-b9944ac68ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd992a73-8b13-4dde-a594-2c4f83963bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd992a73-8b13-4dde-a594-2c4f83963bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58672228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc0cdad-de58-4b55-aaab-4863ceb218bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa5da31-e99c-4273-82c8-b174cacfd05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa5da31-e99c-4273-82c8-b174cacfd05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11ef5e0-d796-4485-be3d-cd31b3089f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11ef5e0-d796-4485-be3d-cd31b3089f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc0cdad-de58-4b55-aaab-4863ceb218bb', 'volume_name': 'volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce90cc24-2f4f-4218-b7d2-364d46936e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce90cc24-2f4f-4218-b7d2-364d46936e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7b1efa-4654-4f53-bff5-afd97344020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume bcc0cdad-de58-4b55-aaab-4863ceb218bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb', 'volume_size': 1} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (b259258d-4c35-4840-8fdd-4577aa737f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45907f9a-b577-4e4d-8ac6-aded0be674ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45907f9a-b577-4e4d-8ac6-aded0be674ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734360228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580264db-d3e8-42d1-b012-ec49cace8e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06417e07-5541-44c9-9167-cc1a18a15b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06417e07-5541-44c9-9167-cc1a18a15b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadc12c2-07d1-40af-a2d4-b5b3a2a99c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dadc12c2-07d1-40af-a2d4-b5b3a2a99c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580264db-d3e8-42d1-b012-ec49cace8e09', 'volume_name': 'volume-580264db-d3e8-42d1-b012-ec49cace8e09', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa2941e-b0aa-48fa-8abd-9ce72818e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa2941e-b0aa-48fa-8abd-9ce72818e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381ad77c-3a15-4035-a9a2-2cc7bdb23902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:19 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume 580264db-d3e8-42d1-b012-ec49cace8e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580264db-d3e8-42d1-b012-ec49cace8e09', 'volume_size': 1} Apr 21 21:00:19 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:20 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8" returned: 0 in 1.999s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:20 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[467a4e84-e5f0-461b-8136-198186e168a0]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:20 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:20 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:20 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:21 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.576s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:21 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Converted 1024.00 MB image at 511.97 MB/s Apr 21 21:00:21 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 is being set with open permissions: ugo+rw Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:21 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 Apr 21 21:00:21 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:21 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8" returned: 0 in 0.386s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-32a90d02-fab8-4e3c-99c6-752596742be8" released by "_copy_volume_from_snapshot" :: held 4.217s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-8e547a41-538a-4f52-91fe-1a972fe64f9f-32a90d02-fab8-4e3c-99c6-752596742be8" released by "_create_volume_from_snapshot" :: held 4.233s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.250s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.927s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-516391489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a9de71-4e22-4aa2-b195-7faeea0bb094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b574b1a5724c421b9279805b1e9af9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:16Z,use_quota=True,user_id='ba8dc58cc12e4a36b14985fe9bce8638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Creating volume 81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:21 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:21 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 1073741824 Apr 21 21:00:21 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2a985e4-2638-40ee-83cd-ac62a89713a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a90d02-fab8-4e3c-99c6-752596742be8', 'volume_size': 1, 'snapshot_id': '8e547a41-538a-4f52-91fe-1a972fe64f9f'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07231c32-a37c-4518-a678-5ee378868c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:21 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Volume volume-32a90d02-fab8-4e3c-99c6-752596742be8 (32a90d02-fab8-4e3c-99c6-752596742be8): created successfully Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07231c32-a37c-4518-a678-5ee378868c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Flow 'volume_create_manager' (dad60a76-ad3b-4b58-9362-69f698d814d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:21 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-a0f109d4-998e-4718-ace8-1bc101ae0f9e tempest-SnapshotDependencyTests-90289795 None] Created volume successfully. Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-8e547a41-538a-4f52-91fe-1a972fe64f9f-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-8e547a41-538a-4f52-91fe-1a972fe64f9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-quobyte-eca27273-cebf-4448-99bf-6d0025e2380e" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-eca27273-cebf-4448-99bf-6d0025e2380e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-quobyte-8e547a41-538a-4f52-91fe-1a972fe64f9f" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-8e547a41-538a-4f52-91fe-1a972fe64f9f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Deleting offline snapshot 8e547a41-538a-4f52-91fe-1a972fe64f9f of volume eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] snapshot_file for this snap is: volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[263acad0-7379-4fb8-82d2-522b64d234eb]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:21 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:21 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f Apr 21 21:00:21 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 1073741824" returned: 0 in 0.498s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:22 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f" returned: 0 in 0.468s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eca27273-cebf-4448-99bf-6d0025e2380e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4c865c-bfca-4704-8fe3-f7444bb7cb70]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:22 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.405s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.132s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-429999269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5c90a4-3b6f-4ce2-a631-42a0be476f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:18Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating volume 4c5c90a4-3b6f-4ce2-a631-42a0be476f44 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:22 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe54c7e-7a91-453f-ad04-6640f1a08dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a9de71-4e22-4aa2-b195-7faeea0bb094', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:22 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 1073741824 Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3a00ff-ceaa-4b5d-946a-97e1bf1b95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:22 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Volume volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 (81a9de71-4e22-4aa2-b195-7faeea0bb094): created successfully Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3a00ff-ceaa-4b5d-946a-97e1bf1b95ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (124b12e0-41b8-443e-aa50-bbaf8e77efef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:22 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d8eeb5b6-714a-4630-bc5c-83083bff78e5 tempest-VolumeDependencyTests-385038631 None] Created volume successfully. Apr 21 21:00:22 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.460s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:22 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f Apr 21 21:00:22 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:22 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:22 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 1073741824" returned: 0 in 0.487s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:23 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 Apr 21 21:00:23 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (c89a6ddb-12f2-4563-89cd-409c661a6940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2872128e-bf49-4590-a267-1a22f8a0e014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2872128e-bf49-4590-a267-1a22f8a0e014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-679714074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d6554d9-d060-4f4d-b7e9-4552fa55f8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b574b1a5724c421b9279805b1e9af9e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=81a9de71-4e22-4aa2-b195-7faeea0bb094,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:23Z,use_quota=True,user_id='ba8dc58cc12e4a36b14985fe9bce8638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f1602f-26d6-4798-9aa2-e62224809b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f1602f-26d6-4798-9aa2-e62224809b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42406e1e-5336-48e3-819e-7d5d48f9a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42406e1e-5336-48e3-819e-7d5d48f9a40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5d6554d9-d060-4f4d-b7e9-4552fa55f8db', 'volume_name': 'volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db', 'volume_size': 1, 'source_volid': '81a9de71-4e22-4aa2-b195-7faeea0bb094', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3980b806-7027-40fc-85b9-e98bc7ebdd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3980b806-7027-40fc-85b9-e98bc7ebdd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7cc2ef-0d80-416b-b11f-1e59764ccd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:23 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Volume 5d6554d9-d060-4f4d-b7e9-4552fa55f8db: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db', 'volume_size': 1, 'source_volid': '81a9de71-4e22-4aa2-b195-7faeea0bb094', 'source_volstatus': 'available'} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:23 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f" returned: 0 in 0.497s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:23 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f Apr 21 21:00:23 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:23 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44" returned: 0 in 0.443s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.828s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032921556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=832f2afe-b597-407f-aa29-d4d1cc8858e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating volume 832f2afe-b597-407f-aa29-d4d1cc8858e1 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:23 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3164e21-95ea-40b8-9ea3-555aea8c268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22ec682-490b-4127-832a-61ae2a04a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:23 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 1073741824 Apr 21 21:00:23 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:23 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 (4c5c90a4-3b6f-4ce2-a631-42a0be476f44): created successfully Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22ec682-490b-4127-832a-61ae2a04a40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (afc78457-6d0d-47a1-97c2-1b873ce1e2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d5be6bb9-0e2b-49fc-8575-047c1b3cd198 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created volume successfully. Apr 21 21:00:23 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e.8e547a41-538a-4f52-91fe-1a972fe64f9f" returned: 0 in 0.402s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-8e547a41-538a-4f52-91fe-1a972fe64f9f" released by "_delete_snapshot" :: held 1.881s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-eca27273-cebf-4448-99bf-6d0025e2380e" released by "delete_snapshot" :: held 1.897s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Created reservations ['0458e142-6487-4f54-9fd3-a4b0f4938beb', 'a59a452a-f3f6-400d-9885-fd0fa1de8bcb', '0008dd26-4bb5-4ee7-b32e-62af716667a7', '2225066f-b277-4a58-abcf-638d8ae476a2'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:23 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Delete snapshot completed successfully. Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d68491b4-659a-436f-a5d6-ba133fa9d46a tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-8e547a41-538a-4f52-91fe-1a972fe64f9f-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:23 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 1073741824" returned: 0 in 0.488s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-eca27273-cebf-4448-99bf-6d0025e2380e-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:23 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-eca27273-cebf-4448-99bf-6d0025e2380e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:23 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 Apr 21 21:00:23 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-quobyte-eca27273-cebf-4448-99bf-6d0025e2380e" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-eca27273-cebf-4448-99bf-6d0025e2380e" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[436614aa-cab7-4cb8-ac5a-687604694430]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:24 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1" returned: 0 in 0.406s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.559s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-76949718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909fa06e-df50-4af6-b746-40437909a185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating volume 909fa06e-df50-4af6-b746-40437909a185 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:24 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968097fc-9732-4fd9-ad9f-a7e43ff8fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-832f2afe-b597-407f-aa29-d4d1cc8858e1', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03b3482-6287-4bce-a31c-33048fcb9666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:24 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 1073741824 Apr 21 21:00:24 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 (832f2afe-b597-407f-aa29-d4d1cc8858e1): created successfully Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03b3482-6287-4bce-a31c-33048fcb9666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (eccc62a7-7a37-4961-b9bc-56935882d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:24 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-bfa0dec7-8f3a-4653-b810-ecb0fa5e16d5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created volume successfully. Apr 21 21:00:24 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.483s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e Apr 21 21:00:24 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:24 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 1073741824" returned: 0 in 0.525s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:24 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:24 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 Apr 21 21:00:24 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-eca27273-cebf-4448-99bf-6d0025e2380e" returned: 0 in 0.484s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-eca27273-cebf-4448-99bf-6d0025e2380e" released by "delete_volume" :: held 0.995s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Created reservations ['e2127c76-b016-4ca6-a865-2a8341642604', '6270ee9e-3557-4574-af99-dd443617f3ca', 'ca498f0d-cdb4-46e9-a2de-fc440135c2c0', '11512a23-dee2-4b45-a50d-260e4be970fa'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:25 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:25 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185" returned: 0 in 0.485s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.386s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-58672228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc0cdad-de58-4b55-aaab-4863ceb218bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating volume bcc0cdad-de58-4b55-aaab-4863ceb218bb {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:25 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2548cc8-04e0-4946-9595-697515da71d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909fa06e-df50-4af6-b746-40437909a185', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26334415-7803-4ac1-b095-66138e57f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:25 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb 1073741824 Apr 21 21:00:25 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:25 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume volume-909fa06e-df50-4af6-b746-40437909a185 (909fa06e-df50-4af6-b746-40437909a185): created successfully Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26334415-7803-4ac1-b095-66138e57f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (6cf7cf27-b580-42fe-8aa0-7fab6623a57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:25 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-6086b763-3e45-44bc-962d-d5d11f6447a2 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created volume successfully. Apr 21 21:00:25 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.420s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:25 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Deleted volume successfully. Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-614b928c-f967-44fc-93e7-dab2a9072c6e tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-eca27273-cebf-4448-99bf-6d0025e2380e-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:25 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb 1073741824" returned: 0 in 0.509s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:25 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb Apr 21 21:00:26 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-32a90d02-fab8-4e3c-99c6-752596742be8-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-32a90d02-fab8-4e3c-99c6-752596742be8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "cinder-quobyte-32a90d02-fab8-4e3c-99c6-752596742be8" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-32a90d02-fab8-4e3c-99c6-752596742be8" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0545ae2-ab4b-4135-96f6-20a0bbeb67f9]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 Apr 21 21:00:26 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb" returned: 0 in 0.449s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.128s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-734360228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580264db-d3e8-42d1-b012-ec49cace8e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ae5fdbcca8d4412bba278d499638ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:19Z,use_quota=True,user_id='c1c7e44b823d4a10b9d60d5e74a0fdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Creating volume 580264db-d3e8-42d1-b012-ec49cace8e09 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:26 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7b1efa-4654-4f53-bff5-afd97344020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 1073741824 Apr 21 21:00:26 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff1899c-d73c-4276-8072-00b171d9a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:26 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb (bcc0cdad-de58-4b55-aaab-4863ceb218bb): created successfully Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff1899c-d73c-4276-8072-00b171d9a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (0255b031-9d8c-4ba7-9fcd-b9944ac68ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:26 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7d5792a5-ef5f-471a-9901-284ec3535833 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created volume successfully. Apr 21 21:00:26 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8" returned: 0 in 0.518s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8 Apr 21 21:00:26 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:26 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 1073741824" returned: 0 in 0.496s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:26 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:26 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 Apr 21 21:00:26 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:27 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-32a90d02-fab8-4e3c-99c6-752596742be8" returned: 0 in 0.448s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-quobyte-32a90d02-fab8-4e3c-99c6-752596742be8" released by "delete_volume" :: held 0.994s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Created reservations ['687292e6-a1db-4340-bcf3-e7d51fae19d0', 'ca7d1030-cad8-41cc-8f3a-728316646015', '62dc4c46-cad8-4cb1-8f0b-2b7af10cfe20', 'b74cbead-7dc3-4465-8314-66fd8e10db94'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:27 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:27 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:27 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09" returned: 0 in 0.461s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.153s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:27 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Cloning volume 81a9de71-4e22-4aa2-b195-7faeea0bb094 to volume 5d6554d9-d060-4f4d-b7e9-4552fa55f8db Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (381ad77c-3a15-4035-a9a2-2cc7bdb23902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580264db-d3e8-42d1-b012-ec49cace8e09', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b80f3b-0b46-42d1-8623-09f45608c50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:27 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Volume volume-580264db-d3e8-42d1-b012-ec49cace8e09 (580264db-d3e8-42d1-b012-ec49cace8e09): created successfully Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b80f3b-0b46-42d1-8623-09f45608c50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Flow 'volume_create_manager' (b259258d-4c35-4840-8fdd-4577aa737f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Creating offline snapshot 4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e of volume 81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:27 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-13169217-dd53-4874-acd4-93696742d9bb tempest-CreateVolumesFromSnapshotTest-321100310 None] Created volume successfully. Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fba06d-e814-4ace-a4ea-a5c77d9f5a9c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:27 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:27 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:27 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.426s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:27 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Deleted volume successfully. Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-3c126ab9-9a70-4eb2-894a-86ec41829939 tempest-SnapshotDependencyTests-90289795 None] Lock "cinder-32a90d02-fab8-4e3c-99c6-752596742be8-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-580264db-d3e8-42d1-b012-ec49cace8e09-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-580264db-d3e8-42d1-b012-ec49cace8e09-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-580264db-d3e8-42d1-b012-ec49cace8e09" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-580264db-d3e8-42d1-b012-ec49cace8e09" acquired by "delete_volume" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7053c31-7bdc-489e-adcb-664b74549a26]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:27 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 Apr 21 21:00:28 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:28 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.519s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e 1G Apr 21 21:00:28 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:28 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09" returned: 0 in 0.572s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09 Apr 21 21:00:28 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:28 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e 1G" returned: 0 in 0.559s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:28 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:28 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e Apr 21 21:00:28 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:29 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-580264db-d3e8-42d1-b012-ec49cace8e09" returned: 0 in 0.508s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-580264db-d3e8-42d1-b012-ec49cace8e09" released by "delete_volume" :: held 1.102s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['4fbe90c6-b48e-419f-87f4-6c026f4a4371', 'ca0edbbd-c397-44a6-b696-205ee90956b3', 'b2d0d338-5dac-4804-a018-e7fb837ec206', '1870b179-f6ee-4df4-8067-d0fe4ec46900'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:29 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" returned: 0 in 0.479s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:29 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e is being set with open permissions: ugo+rw Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:29 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e Apr 21 21:00:29 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:29 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:29 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:29 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" returned: 0 in 0.451s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:29 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.440s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:29 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleted volume successfully. Apr 21 21:00:29 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info Apr 21 21:00:29 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:29 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e10eb148-0721-4ab1-ad3b-7c412852628d tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-580264db-d3e8-42d1-b012-ec49cace8e09-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:30 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info" returned: 0 in 0.491s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:30 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info is being set with open permissions: ugo+rw Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:30 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info Apr 21 21:00:30 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-bcc0cdad-de58-4b55-aaab-4863ceb218bb-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-bcc0cdad-de58-4b55-aaab-4863ceb218bb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-bcc0cdad-de58-4b55-aaab-4863ceb218bb" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-bcc0cdad-de58-4b55-aaab-4863ceb218bb" acquired by "delete_volume" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e4d548-2105-4865-b9db-e63b7741e507]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:30 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb Apr 21 21:00:30 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:30 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.info" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" by "_copy_volume_from_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] snapshot: 4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e, volume: 5d6554d9-d060-4f4d-b7e9-4552fa55f8db, {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[31060e8a-a074-4259-a9f0-3f8de37ba59c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:30 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e Apr 21 21:00:30 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:30 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb" returned: 0 in 0.544s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:30 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:30 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb Apr 21 21:00:30 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-bcc0cdad-de58-4b55-aaab-4863ceb218bb" returned: 0 in 0.443s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-bcc0cdad-de58-4b55-aaab-4863ceb218bb" released by "delete_volume" :: held 1.012s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:31 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" returned: 0 in 0.593s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a9de71-4e22-4aa2-b195-7faeea0bb094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Creating direct copy from snapshot {{(pid=81991) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cf76a8-88fd-4302-a4eb-bec9fc2bbc4f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['42d433b4-67bb-4544-8d09-bb60261cb2ff', '41d7e338-a7ea-4338-ac2b-6409824e18ea', 'cd3fb298-b053-428e-9d9f-2f5d3c98c0eb', '25a3717d-b852-42a4-ba61-780cb66f11e6'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:31 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:31 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:31 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:31 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.520s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.utils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Path /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db not found in is_blk_device check {{(pid=81991) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:31 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.463s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:31 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleted volume successfully. Apr 21 21:00:31 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db Apr 21 21:00:31 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:31 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-8b9b223e-271c-4816-8494-53772063a500 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-bcc0cdad-de58-4b55-aaab-4863ceb218bb-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-909fa06e-df50-4af6-b746-40437909a185-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-909fa06e-df50-4af6-b746-40437909a185-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-909fa06e-df50-4af6-b746-40437909a185" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:32 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-909fa06e-df50-4af6-b746-40437909a185" acquired by "delete_volume" :: waited 0.020s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:32 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16c79cb-bf0d-4664-9f27-24ee38101c0c]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:32 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:32 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 Apr 21 21:00:32 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:33 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" returned: 0 in 2.074s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:33 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f3242-4681-4426-950a-f304f4d0ba93]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:33 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:33 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:33 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185" returned: 0 in 1.353s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:33 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:33 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185 Apr 21 21:00:33 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-909fa06e-df50-4af6-b746-40437909a185" returned: 0 in 0.500s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-909fa06e-df50-4af6-b746-40437909a185" released by "delete_volume" :: held 1.882s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:34 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.642s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.image.image_utils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Image conversion details: src /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db {{(pid=81991) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 21 21:00:34 devstack cinder-volume[81991]: INFO cinder.image.image_utils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Converted 1024.00 MB image at 493.38 MB/s Apr 21 21:00:34 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db is being set with open permissions: ugo+rw Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['27823a6c-66cf-4eff-8e42-0551d600d918', '1703d2b7-24a4-4fab-bb79-009c1b652662', 'abc12410-9d67-4424-8290-568a91a6b444', 'fb159ff9-50c2-4bb7-924a-288f0dc1ed3c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:34 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db Apr 21 21:00:34 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:34 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-832f2afe-b597-407f-aa29-d4d1cc8858e1-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-832f2afe-b597-407f-aa29-d4d1cc8858e1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-832f2afe-b597-407f-aa29-d4d1cc8858e1" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-832f2afe-b597-407f-aa29-d4d1cc8858e1" acquired by "delete_volume" :: waited 0.016s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80cc295-b5f8-42f7-9e8d-af688c2d7ca3]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:34 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 Apr 21 21:00:34 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:34 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.500s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:34 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:34 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleted volume successfully. Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-1b4cae8e-81ac-4d6c-8976-e79c07ede012 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-909fa06e-df50-4af6-b746-40437909a185-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:35 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" returned: 0 in 0.615s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" released by "_copy_volume_from_snapshot" :: held 4.495s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Deleting offline snapshot 4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e of volume 81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] snapshot_file for this snap is: volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a74c71-638f-47cf-9358-5d87dd366a8d]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e Apr 21 21:00:35 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1" returned: 0 in 0.524s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1 Apr 21 21:00:35 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" returned: 0 in 0.530s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a9de71-4e22-4aa2-b195-7faeea0bb094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7e7d7-376f-4453-be22-b2624579eeab]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:35 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:35 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-832f2afe-b597-407f-aa29-d4d1cc8858e1" returned: 0 in 0.533s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-832f2afe-b597-407f-aa29-d4d1cc8858e1" released by "delete_volume" :: held 1.088s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['bbc80a9e-af74-42cc-ace8-f64df115dee0', 'f664beac-d2de-4061-8ff3-9bd807cb5ae1', '41f9c9a9-2783-4c9e-8db1-4d1a570ba956', '052ceb7b-fa5a-46f9-a23b-0dea23d37779'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:35 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:35 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:35 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.554s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:36 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e Apr 21 21:00:36 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.429s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:36 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleted volume successfully. Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-49ef1999-a21c-4e03-86b6-6a100ee05de5 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-832f2afe-b597-407f-aa29-d4d1cc8858e1-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:36 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" returned: 0 in 0.446s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:36 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e Apr 21 21:00:36 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-4c5c90a4-3b6f-4ce2-a631-42a0be476f44-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-4c5c90a4-3b6f-4ce2-a631-42a0be476f44-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-4c5c90a4-3b6f-4ce2-a631-42a0be476f44" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-4c5c90a4-3b6f-4ce2-a631-42a0be476f44" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94db77-7398-4934-82f4-7e4bd99ad383]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:36 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094.4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" returned: 0 in 0.423s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 Apr 21 21:00:37 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-4ea5c960-a9d7-4f5e-ae29-5a9482a7a57e" released by "_delete_snapshot" :: held 2.007s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.642s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7cc2ef-0d80-416b-b11f-1e59764ccd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db', 'volume_size': 1, 'source_volid': '81a9de71-4e22-4aa2-b195-7faeea0bb094', 'source_volstatus': 'available'}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c0cf18-8c5f-4a73-a302-9a5647e12416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:37 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Volume volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db (5d6554d9-d060-4f4d-b7e9-4552fa55f8db): created successfully Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c0cf18-8c5f-4a73-a302-9a5647e12416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Flow 'volume_create_manager' (c89a6ddb-12f2-4563-89cd-409c661a6940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:37 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-d9c09a0a-bad3-4b5d-a6b1-0a658ffdcc89 tempest-VolumeDependencyTests-385038631 None] Created volume successfully. Apr 21 21:00:37 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44 Apr 21 21:00:37 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-4c5c90a4-3b6f-4ce2-a631-42a0be476f44" returned: 0 in 0.394s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-4c5c90a4-3b6f-4ce2-a631-42a0be476f44" released by "delete_volume" :: held 0.866s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['44c7d09f-9946-4208-b228-77112f3e0544', 'eb72c7d9-05a8-4f99-9961-07bffb81cd84', 'cf3eefb6-958e-4107-9bd7-000caf5ef50a', '3c12a1cb-22b9-4826-9117-858e5cb033ad'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:37 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:37 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:37 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-81a9de71-4e22-4aa2-b195-7faeea0bb094-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-81a9de71-4e22-4aa2-b195-7faeea0bb094-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-81a9de71-4e22-4aa2-b195-7faeea0bb094" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-81a9de71-4e22-4aa2-b195-7faeea0bb094" acquired by "delete_volume" :: waited 0.018s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-773d1fb5-471a-4ca9-9907-d29761c985ac-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92cefa5-e9a0-4326-9914-c792a722d59e]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-773d1fb5-471a-4ca9-9907-d29761c985ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-219ac45c-e589-43ce-8b7b-6e75db6216b1" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-219ac45c-e589-43ce-8b7b-6e75db6216b1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-773d1fb5-471a-4ca9-9907-d29761c985ac" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-773d1fb5-471a-4ca9-9907-d29761c985ac" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleting offline snapshot 773d1fb5-471a-4ca9-9907-d29761c985ac of volume 219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] snapshot_file for this snap is: volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff98baa-843d-4354-b4fe-b0a5f10fb087]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:38 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:38 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac Apr 21 21:00:38 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.450s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:38 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleted volume successfully. Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-9a0ff955-4584-48dc-ba1b-fc7eded8126c tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-4c5c90a4-3b6f-4ce2-a631-42a0be476f44-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:38 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.479s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:38 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094 Apr 21 21:00:38 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-219ac45c-e589-43ce-8b7b-6e75db6216b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4301869-88c7-4179-9fb6-463108d94197]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:38 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 Apr 21 21:00:38 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:38 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-81a9de71-4e22-4aa2-b195-7faeea0bb094" returned: 0 in 0.398s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-81a9de71-4e22-4aa2-b195-7faeea0bb094" released by "delete_volume" :: held 0.912s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:38 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Created reservations ['9b426de5-3ccc-4895-a4d9-0b2cfab22d0a', '5d45f629-5ef5-49a1-831c-a2cea102320c', '27c3515d-cc30-44cf-93d8-c77935b7e60b', '9b528804-1258-45a4-be84-c4767fabacb9'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:39 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-5d6554d9-d060-4f4d-b7e9-4552fa55f8db-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:39 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-5d6554d9-d060-4f4d-b7e9-4552fa55f8db-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1" returned: 0 in 0.516s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac Apr 21 21:00:39 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" acquired by "delete_volume" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4cd37-db99-4e09-ae10-d1e409fa9685]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db Apr 21 21:00:39 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.433s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:39 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Deleted volume successfully. Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-db1436e1-6c76-404d-abb3-bef59c61ab28 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-81a9de71-4e22-4aa2-b195-7faeea0bb094-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:39 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac" returned: 0 in 0.478s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[90320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac Apr 21 21:00:39 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" returned: 0 in 0.487s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:39 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db Apr 21 21:00:39 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:39 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:39 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1.773d1fb5-471a-4ca9-9907-d29761c985ac" returned: 0 in 0.388s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-773d1fb5-471a-4ca9-9907-d29761c985ac" released by "_delete_snapshot" :: held 1.911s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-219ac45c-e589-43ce-8b7b-6e75db6216b1" released by "delete_snapshot" :: held 1.924s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['2bf4e0f6-0eef-4d3d-8bc2-491e4411fcf5', 'e1096761-85b0-48bb-8e08-212a2d613bef', 'e8be0d66-8b42-4643-bb8c-c173ea92b44f', '6f9e5883-01ce-4efb-aed9-099fa449dbd1'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:40 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" returned: 0 in 0.407s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-5d6554d9-d060-4f4d-b7e9-4552fa55f8db" released by "delete_volume" :: held 0.916s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Delete snapshot completed successfully. Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-dd0060c5-3127-4f30-80ca-3c3ba300abd3 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-773d1fb5-471a-4ca9-9907-d29761c985ac-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Created reservations ['50185daf-9c26-40da-bc87-2e7ef7acb7e6', '43d3cd80-8137-467b-83ac-135122850ff9', 'e90d8990-f609-4942-bf1e-f22985f1e76e', '27064980-6675-4e14-abdc-742b387bdf63'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-219ac45c-e589-43ce-8b7b-6e75db6216b1-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-219ac45c-e589-43ce-8b7b-6e75db6216b1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:40 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:40 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "cinder-quobyte-219ac45c-e589-43ce-8b7b-6e75db6216b1" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-219ac45c-e589-43ce-8b7b-6e75db6216b1" acquired by "delete_volume" :: waited 0.006s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c59f5cd-9409-403e-886b-a6ff3b171b2b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "cinder-quobyte-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:40 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 Apr 21 21:00:40 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184fe27-1036-49b8-beb4-da926d6564f8]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:40 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 Apr 21 21:00:40 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:40 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.435s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:40 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Deleted volume successfully. Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-76787832-eb99-4baf-b820-d5ea19b217a4 tempest-VolumeDependencyTests-385038631 None] Lock "cinder-5d6554d9-d060-4f4d-b7e9-4552fa55f8db-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:40 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1" returned: 0 in 0.487s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:40 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1 Apr 21 21:00:40 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:40 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" returned: 0 in 0.453s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:40 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:40 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6 Apr 21 21:00:40 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:41 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-219ac45c-e589-43ce-8b7b-6e75db6216b1" returned: 0 in 0.389s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-quobyte-219ac45c-e589-43ce-8b7b-6e75db6216b1" released by "delete_volume" :: held 0.905s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Created reservations ['791f592d-f053-48f2-9891-51b0f2bb1a33', '5ab057ea-8490-4ed4-8be0-7d21c9d0227e', '4d0df909-2ef2-4fa9-98e7-754bfdbf7590', '23a924f8-1907-4813-8539-376cc18de909'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:41 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" returned: 0 in 0.403s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-quobyte-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6" released by "delete_volume" :: held 0.880s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Created reservations ['4123b220-c51b-4cef-8695-c61c4d68ae96', 'e5dc7436-3640-45d7-b34d-15f8d12a66e6', 'cfcc84b3-d6ca-4050-8a2e-91128ec628d6', '7b1c8e24-4477-4c3f-8b25-d3c66b6a45ff'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:41 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:41 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:41 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:41 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:41 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.529s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Deleted volume successfully. Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-b2f6419e-3bff-4901-8546-aced7d2d6c41 tempest-CreateVolumesFromSnapshotTest-321100310 None] Lock "cinder-219ac45c-e589-43ce-8b7b-6e75db6216b1-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:41 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.581s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:41 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Deleted volume successfully. Apr 21 21:00:41 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-0bea9533-e64a-4c34-877d-549f8152e23e tempest-VolumeDependencyTests-385038631 None] Lock "cinder-8c0fef05-e2bb-41ce-89d9-5314aafbdeb6-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Flow 'volume_create_manager' (5b49f777-a26c-4f86-a801-02967372494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ec6c9b-280d-402f-9bd5-d1d556d08bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ec6c9b-280d-402f-9bd5-d1d556d08bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77659429-0adc-4d38-8bad-8b5613994762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e0a10cc6a24618adc367852b1f6706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:43Z,use_quota=True,user_id='5e0ed16111eb41ebaa9812a5276b8974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231c6cfa-d72f-44f6-996b-175d30f6ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231c6cfa-d72f-44f6-996b-175d30f6ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e72731-2d6a-40bb-97ce-b8cb15d23304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e72731-2d6a-40bb-97ce-b8cb15d23304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77659429-0adc-4d38-8bad-8b5613994762', 'volume_name': 'volume-77659429-0adc-4d38-8bad-8b5613994762', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b70af8-7659-4618-b2c2-7042fdf5e43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b70af8-7659-4618-b2c2-7042fdf5e43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29290d70-53d5-470c-9f14-4dd6b465bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:43 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Volume 77659429-0adc-4d38-8bad-8b5613994762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77659429-0adc-4d38-8bad-8b5613994762', 'volume_size': 1} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77659429-0adc-4d38-8bad-8b5613994762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e0a10cc6a24618adc367852b1f6706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:43Z,use_quota=True,user_id='5e0ed16111eb41ebaa9812a5276b8974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Creating volume 77659429-0adc-4d38-8bad-8b5613994762 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:43 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:43 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 1073741824 Apr 21 21:00:43 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:43 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 1073741824" returned: 0 in 0.444s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:43 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:43 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 Apr 21 21:00:43 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:44 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762" returned: 0 in 0.384s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29290d70-53d5-470c-9f14-4dd6b465bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77659429-0adc-4d38-8bad-8b5613994762', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0a0061-1411-4854-ab3e-b0b60fd10476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Volume volume-77659429-0adc-4d38-8bad-8b5613994762 (77659429-0adc-4d38-8bad-8b5613994762): created successfully Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0a0061-1411-4854-ab3e-b0b60fd10476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Flow 'volume_create_manager' (5b49f777-a26c-4f86-a801-02967372494c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:44 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-5484602a-6577-400b-8a17-b3a21a3adbd6 tempest-CinderUnicodeTest-942398289 None] Created volume successfully. Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81991) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Flow 'volume_create_manager' (779e642f-ecef-4d4c-9815-bb4421af82b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482d367e-be44-49be-b789-4fac6c13a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482d367e-be44-49be-b789-4fac6c13a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-527627901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a5019a-30db-4fd7-b4e6-e2d9954b05a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e0a10cc6a24618adc367852b1f6706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:44Z,use_quota=True,user_id='5e0ed16111eb41ebaa9812a5276b8974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bf84d2-80e5-44d6-a263-32f644f1c80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15bf84d2-80e5-44d6-a263-32f644f1c80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0496d95a-0960-45df-a2bb-8507cb4319af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0496d95a-0960-45df-a2bb-8507cb4319af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a5019a-30db-4fd7-b4e6-e2d9954b05a6', 'volume_name': 'volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7b1827-5079-4a37-854b-8f65db2d2a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7b1827-5079-4a37-854b-8f65db2d2a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f697515b-36ed-49e7-8b22-8a4d7a8bd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:44 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Volume f6a5019a-30db-4fd7-b4e6-e2d9954b05a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6', 'volume_size': 1} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-21T19:00:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-527627901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a5019a-30db-4fd7-b4e6-e2d9954b05a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e0a10cc6a24618adc367852b1f6706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T19:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T19:00:44Z,use_quota=True,user_id='5e0ed16111eb41ebaa9812a5276b8974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91c19e0-2a29-493d-974b-ce54f4eb21cc),volume_type_id=b91c19e0-2a29-493d-974b-ce54f4eb21cc)}" {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Creating volume f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Selected osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc as target Quobyte volume. {{(pid=81991) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 21 21:00:44 devstack cinder-volume[81991]: INFO cinder.volume.drivers.remotefs [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] casted to osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 1073741824 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:44 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 1073741824 Apr 21 21:00:44 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:44 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:44 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 1073741824" returned: 0 in 0.452s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:45 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 Apr 21 21:00:45 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:45 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" returned: 0 in 0.381s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'} {{(pid=81991) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f697515b-36ed-49e7-8b22-8a4d7a8bd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6', 'volume_size': 1}' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f8f600-c8a7-435e-9dbe-fc6203599ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 21 21:00:45 devstack cinder-volume[81991]: INFO cinder.volume.flows.manager.create_volume [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Volume volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 (f6a5019a-30db-4fd7-b4e6-e2d9954b05a6): created successfully Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f8f600-c8a7-435e-9dbe-fc6203599ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81991) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Flow 'volume_create_manager' (779e642f-ecef-4d4c-9815-bb4421af82b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81991) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 21 21:00:45 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-39c75799-6ae9-4faf-80c6-ad4bf8b5490a tempest-CinderUnicodeTest-942398289 None] Created volume successfully. Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Creating offline snapshot 395af862-93d3-42eb-be57-aa238d1c086d of volume f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a6874-ccbc-41a6-92d2-4751ad434e06]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:45 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:45 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 Apr 21 21:00:45 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" returned: 0 in 0.435s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d 1G {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:46 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d 1G Apr 21 21:00:46 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d 1G" returned: 0 in 0.440s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:46 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d Apr 21 21:00:46 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:46 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 -F qcow2 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d" returned: 0 in 0.409s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:46 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d is being set with open permissions: ugo+rw Apr 21 21:00:46 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:47 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d Apr 21 21:00:47 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:47 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d" returned: 0 in 0.387s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:47 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=300,cinder:SELECT=185,cinder:INSERT=58,cinder:DELETE=28 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:00:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:47 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info Apr 21 21:00:47 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:47 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info" returned: 0 in 0.397s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:47 devstack cinder-volume[81991]: WARNING cinder.volume.drivers.remotefs [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info is being set with open permissions: ugo+rw Apr 21 21:00:47 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:47 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info Apr 21 21:00:47 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:48 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.info" returned: 0 in 0.388s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:48 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-f0864efd-7e4b-4368-ae6b-ecce19793854 tempest-CinderUnicodeTest-942398289 None] Create snapshot completed successfully Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-395af862-93d3-42eb-be57-aa238d1c086d-delete_snapshot" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-395af862-93d3-42eb-be57-aa238d1c086d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-quobyte-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" by "delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-quobyte-395af862-93d3-42eb-be57-aa238d1c086d" by "_delete_snapshot" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-395af862-93d3-42eb-be57-aa238d1c086d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Deleting offline snapshot 395af862-93d3-42eb-be57-aa238d1c086d of volume f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] snapshot_file for this snap is: volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d {{(pid=81991) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e6bc6-e8b6-4e04-8ebe-a8c18565c254]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:48 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:48 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d Apr 21 21:00:48 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:49 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:49 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.remotefs [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81991) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 21 21:00:49 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e21a6c4-e186-4546-acc2-08f9ed8d9fa6]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:49 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 Apr 21 21:00:49 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:49 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" returned: 0 in 0.441s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:49 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:49 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d Apr 21 21:00:49 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:50 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d" returned: 0 in 0.414s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:50 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d Apr 21 21:00:50 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:50 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6.395af862-93d3-42eb-be57-aa238d1c086d" returned: 0 in 0.381s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-395af862-93d3-42eb-be57-aa238d1c086d" released by "_delete_snapshot" :: held 1.733s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" released by "delete_snapshot" :: held 1.746s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Created reservations ['41f88092-dc99-426b-b688-16310f7bff20', 'ee367ac2-a91d-465c-bb96-2c4f370908ba', '0591340a-6ffa-4e14-a7e5-4164497c1a68', '3b14d4b2-f82a-4bf6-9176-cc0480813823'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:50 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Delete snapshot completed successfully. Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-7f175cd2-fc28-4c87-9d4f-aef8c659c390 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-395af862-93d3-42eb-be57-aa238d1c086d-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-quobyte-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" acquired by "delete_volume" :: waited 0.008s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac02920-c2be-4b04-896e-9ba0f310c37b]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:50 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:51 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 Apr 21 21:00:51 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:51 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" returned: 0 in 0.458s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:51 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6 Apr 21 21:00:51 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:51 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" returned: 0 in 0.398s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6" released by "delete_volume" :: held 0.889s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Created reservations ['8e60ad33-f656-47e8-89dc-c8525b2d50aa', '1f7a67fa-6e41-4137-a52e-6b3d33538259', '18926489-5825-4b0e-a064-377fdde82877', 'eb032925-c706-415b-9d5b-426d54f2e853'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:51 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:51 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_service.periodic_task [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81991) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:51 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:52 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:52 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-77659429-0adc-4d38-8bad-8b5613994762-delete_volume" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Lock "cinder-77659429-0adc-4d38-8bad-8b5613994762-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Acquiring lock "cinder-quobyte-77659429-0adc-4d38-8bad-8b5613994762" by "delete_volume" {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-77659429-0adc-4d38-8bad-8b5613994762" acquired by "delete_volume" :: waited 0.017s {{(pid=81991) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9aac02-835c-46f9-bf68-4e7b71dba26f]: (4, 'qcow2') {{(pid=82872) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:52 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 Apr 21 21:00:52 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.441s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:52 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Deleted volume successfully. Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-325993bd-43be-47ea-b561-3c845386fa90 tempest-CinderUnicodeTest-942398289 None] Lock "cinder-f6a5019a-30db-4fd7-b4e6-e2d9954b05a6-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:52 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.408s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-d7d8281f-055b-4c54-bd3b-71549aa631a7 None None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:52 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762" returned: 0 in 0.457s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:52 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762 Apr 21 21:00:52 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:52 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b/volume-77659429-0adc-4d38-8bad-8b5613994762" returned: 0 in 0.399s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:52 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Lock "cinder-quobyte-77659429-0adc-4d38-8bad-8b5613994762" released by "delete_volume" :: held 0.877s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG cinder.quota [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Created reservations ['b3733ef9-b5d0-437a-9c6e-620f3ee70159', 'ad8b506b-bec7-489e-b904-1fa45af4231f', 'df33f7f4-12f8-4d7f-83e9-418d8ed2949f', '3539b15e-587b-46dc-ad0a-1d19cbab635c'] {{(pid=81991) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc': None} {{(pid=81991) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG cinder.volume.drivers.quobyte [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b1402e0c-b477-4c6b-a268-dfca8f5e5cfc'] {{(pid=81991) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.lockutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81991) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 21 21:00:53 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b Apr 21 21:00:53 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 21 21:00:53 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG oslo_concurrency.processutils [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/26ca157043c2a30a23f96f398652580b" returned: 0 in 0.447s {{(pid=81991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG cinder.manager [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Notifying Schedulers of capabilities ... {{(pid=81991) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 21 21:00:53 devstack cinder-volume[81991]: INFO cinder.volume.manager [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Deleted volume successfully. Apr 21 21:00:53 devstack cinder-volume[81991]: DEBUG cinder.coordination [None req-e359d196-a69f-4bd7-b351-226c466f83ec tempest-CinderUnicodeTest-942398289 None] Lock "cinder-77659429-0adc-4d38-8bad-8b5613994762-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=81991) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 21 21:01:03 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:SELECT=211,cinder:INSERT=77,cinder:UPDATE=263,cinder:DELETE=20 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 21 21:01:03 devstack cinder-volume[81991]: DEBUG dbcounter [-] [81991] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:INSERT=8,cinder:DELETE=2 {{(pid=81991) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}